Sep 05 20:41:15 devstack cinder-volume[76654]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 20:41:15 devstack cinder-volume[76654]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 20:41:15 devstack cinder-volume[76654]: we strongly recommend against using it for new projects. Sep 05 20:41:15 devstack cinder-volume[76654]: If you are already using Eventlet, we recommend migrating to a different Sep 05 20:41:15 devstack cinder-volume[76654]: framework. For more detail see Sep 05 20:41:15 devstack cinder-volume[76654]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 20:41:15 devstack cinder-volume[76654]: import eventlet # noqa Sep 05 20:41:18 devstack cinder-volume[76654]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:41:18 devstack cinder-volume[76654]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:41:18 devstack cinder-volume[76654]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:41:19 devstack cinder-volume[76654]: INFO dbcounter [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Registered counter for database cinder Sep 05 20:41:19 devstack cinder-volume[76654]: DEBUG oslo_db.sqlalchemy.engines [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76654) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:41:19 devstack cinder-volume[76654]: DEBUG dbcounter [-] [76654] Writer thread running {{(pid=76654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:41:19 devstack cinder-volume[76654]: INFO cinder.rpc [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 20:41:19 devstack cinder-volume[76654]: INFO cinder.rpc [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 20:41:19 devstack cinder-volume[76654]: DEBUG oslo_db.sqlalchemy.engines [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76654) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:41:19 devstack cinder-volume[76654]: INFO cinder.volume.manager [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Determined volume DB was empty at startup. Sep 05 20:41:19 devstack cinder-volume[76654]: DEBUG cinder.volume.manager [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76654) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 20:41:19 devstack cinder-volume[76654]: INFO cinder.volume.manager [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 20:41:19 devstack cinder-volume[76654]: WARNING stevedore.named [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 20:41:19 devstack cinder-volume[76654]: WARNING castellan.key_manager [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:41:19 devstack cinder-volume[76654]: WARNING cinder.keymgr.conf_key_mgr [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:41:19 devstack cinder-volume[76654]: DEBUG cinder.volume.drivers.lvm [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76654) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 05 20:41:19 devstack cinder-volume[76654]: DEBUG oslo_concurrency.processutils [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_concurrency.processutils [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] CMD "cinder-rtstool verify" returned: 0 in 0.460s {{(pid=76654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_db.sqlalchemy.engines [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76654) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:41:20 devstack cinder-volume[76654]: INFO cinder.rpc [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 05 20:41:20 devstack cinder-volume[76654]: INFO cinder.rpc [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 05 20:41:20 devstack cinder-volume[76654]: WARNING stevedore.named [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 20:41:20 devstack cinder-volume[76654]: WARNING castellan.key_manager [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:41:20 devstack cinder-volume[76654]: INFO cinder.volume.manager [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_db.sqlalchemy.engines [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76654) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:41:20 devstack cinder-volume[76654]: INFO oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Starting 1 workers Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Started child 76815 {{(pid=76654) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Full set of CONF: {{(pid=76654) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] ******************************************************************************** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Configuration options gathered from: {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] ================================================================================ {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] allow_availability_zone_fallback = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] allow_compression_on_image_upload = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] allowed_direct_url_schemes = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] api_rate_limit = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] auth_strategy = keystone {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] az_cache_duration = 3600 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_availability_zone = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_host = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_stats_polling_interval = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backup_api_class = cinder.backup.api.API {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76815]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backup_name_template = backup-%s {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backup_use_same_host = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backup_use_temp_snapshot = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] chap_password = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] chap_username = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_internal_tenant_project_id = d0b64bf38faf444baf5cb6c57ec49b1e {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_internal_tenant_user_id = ecfcec7e697b4b268149bb224869591a {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cloned_volume_same_az = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cluster = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] compression_format = gzip {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] compute_api_class = cinder.compute.nova.API {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] config_dir = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] config_source = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] control_exchange = openstack {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] debug = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] default_availability_zone = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] default_group_type = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] default_volume_type = lvmdriver-1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] disk_geometry = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] driver_client_cert = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] driver_client_cert_key = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] driver_data_namespace = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] driver_ssl_cert_path = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] driver_ssl_cert_verify = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] driver_use_ssl = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] enable_force_upload = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] enable_new_services = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] enable_unsupported_driver = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] enabled_backends = ['lvmdriver-1'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] enforce_multipath_for_image_xfer = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] filter_function = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_api_insecure = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_api_ssl_compression = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_ca_certificates_file = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_catalog_info = image:glance:publicURL {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_certfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_keyfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_num_retries = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance_request_timeout = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] goodness_function = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] graceful_shutdown_timeout = 5 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] group_api_class = cinder.group.api.API {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] host = devstack {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_compress_on_upload = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_conversion_address_space_limit = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_conversion_cpu_limit = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_conversion_disable = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_upload_use_cinder_backend = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_upload_use_internal_tenant = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_volume_cache_enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_volume_cache_max_count = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] image_volume_cache_max_size_gb = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] init_host_max_objects_retrieval = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] instance_format = [instance: %(uuid)s] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] iscsi_target_flags = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] iscsi_write_cache = on {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] iser_helper = tgtadm {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] iser_ip_address = 192.168.122.147 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] iser_port = 3260 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_color = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_config_append = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_dir = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_file = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_options = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_rotate_interval = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_rotate_interval_type = days {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] log_rotation_type = none {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] max_age = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] max_logfile_count = 30 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] max_logfile_size_mb = 200 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] max_over_subscription_ratio = 20.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] message_reap_interval = 86400 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] message_ttl = 2592000 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] migration_create_volume_timeout_secs = 300 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] monkey_patch = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] monkey_patch_modules = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] my_ip = 192.168.122.147 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] no_snapshot_gb_quota = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] num_iser_scan_tries = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] num_shell_tries = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] num_volume_device_scan_tries = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] nvmeof_conn_info_version = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] nvmet_ns_id = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] nvmet_port_id = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] osapi_max_limit = 1000 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] osapi_volume_ext_list = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] osapi_volume_listen = 0.0.0.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] osapi_volume_listen_port = 8776 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] osapi_volume_use_ssl = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] osapi_volume_workers = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] per_volume_size_limit = -1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] periodic_fuzzy_delay = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] periodic_interval = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] project_id_regex = [0-9a-f\-]+ {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] public_endpoint = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] publish_errors = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] quota_backup_gigabytes = 1000 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] quota_backups = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] quota_gigabytes = 1000 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] quota_groups = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] quota_snapshots = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] quota_volumes = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] rate_limit_burst = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] rate_limit_except_level = CRITICAL {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] rate_limit_interval = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] reinit_driver_count = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] replication_device = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] report_discard_supported = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] report_interval = 120 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] reservation_clean_interval = 86400 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] reservation_expire = 86400 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] reserved_image_namespaces = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] reserved_percentage = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] rpc_response_timeout = 120 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] run_external_periodic_tasks = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] scst_target_driver = iscsi {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] scst_target_iqn_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_down_time = 720 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] shell_completion = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] snapshot_name_template = snapshot-%s {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] snapshot_same_host = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] split_loggers = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] state_path = /opt/stack/data/cinder {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] storage_availability_zone = nova {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] storage_protocol = iSCSI {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76815]: INFO cinder.volume.manager [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] syslog_log_facility = LOG_USER {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] target_helper = lioadm {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] target_ip_address = 192.168.122.147 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] target_port = 3260 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] target_protocol = iscsi {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] target_secondary_ip_addresses = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] trace_flags = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] transfer_api_class = cinder.transfer.api.API {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] transport_url = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] until_refresh = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] use_chap_auth = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] use_default_quota_class = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] use_journal = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] use_json = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] use_multipath_for_image_xfer = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] use_stderr = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] use_syslog = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] verify_glance_signatures = enabled {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_api_class = cinder.volume.api.API {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_backend_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_clear = zero {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_clear_ionice = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_clear_size = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_copy_bps_limit = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_dd_blocksize = 1M {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_name_template = volume-%s {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_service_inithost_offload = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volume_usage_audit_period = month {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] zoning_mode = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_concurrency.disable_process_locking = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.auth_section = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.auth_type = password {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.auth_version = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.cache = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.certfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.delay_auth_decision = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.http_connect_timeout = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.include_service_catalog = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.insecure = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.interface = public {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.keyfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_password = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcache_username = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.region_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.service_token_roles_required = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.service_type = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.token_cache_time = 300 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.backend = dogpile.cache.null {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.backend_argument = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.backend_expiration_time = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.config_prefix = cache.oslo {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.debug_cache_backend = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.enable_retry_client = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.enable_socket_keepalive = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.expiration_time = 600 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.hashclient_retry_attempts = 2 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.memcache_dead_retry = 300 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.memcache_pool_maxsize = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.memcache_sasl_enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.password = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.proxies = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.redis_db = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.redis_sentinel_service_name = mymaster {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.redis_server = localhost:6379 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.retry_attempts = 2 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.retry_delay = 0.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.socket_keepalive_count = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.socket_keepalive_idle = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.socket_keepalive_interval = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.socket_timeout = 1.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.tls_allowed_ciphers = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.tls_cafile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.tls_certfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.tls_enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.tls_keyfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cache.username = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] coordination.backend_url = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.asyncio_connection = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.asyncio_slave_connection = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.backend = sqlalchemy {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.connection = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.connection_debug = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.connection_parameters = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.connection_recycle_time = 3600 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.connection_trace = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.db_inc_retry_interval = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.db_max_retries = 20 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.db_max_retry_interval = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.db_retry_interval = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.max_overflow = 50 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.max_pool_size = 5 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.max_retries = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.mysql_wsrep_sync_wait = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.pool_timeout = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.retry_interval = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.slave_connection = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.sqlite_synchronous = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.synchronous_reader = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] database.use_db_reconnect = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_tracing.insecure = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.connection_string = messaging:// {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.es_doc_type = notification {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.es_scroll_size = 10000 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.es_scroll_time = 2m {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.filter_error_trace = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.hmac_keys = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.sentinel_service_name = mymaster {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.socket_timeout = 0.1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.trace_requests = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler.trace_sqlalchemy = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler_jaeger.process_tags = {} {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler_jaeger.service_name_prefix = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] profiler_otlp.service_name_prefix = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.enforce_new_defaults = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.policy_default_rule = default {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.policy_file = policy.yaml {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_policy.remote_timeout = 60.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] privsep_osbrick.group = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] privsep_osbrick.helper_command = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] privsep_osbrick.user = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_sys_admin.group = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_sys_admin.helper_command = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] cinder_sys_admin.user = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.auth_section = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.auth_type = password {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.cafile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.certfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.collect_timing = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.insecure = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.keyfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.send_service_user_token = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.split_loggers = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.timeout = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.tls_ciphers = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] service_user.tls_min_version = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.auth_section = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.auth_type = password {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.certfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.collect_timing = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.insecure = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.keyfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.region_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.split_loggers = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.timeout = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.tls_ciphers = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] glance.tls_min_version = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.backend_availability_zone = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.chap_password = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.chap_username = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.disk_geometry = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.driver_client_cert = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.driver_client_cert_key = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.driver_data_namespace = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.driver_use_ssl = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.enable_unsupported_driver = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.extra_capabilities = {} {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.filter_function = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.goodness_function = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.iscsi_target_flags = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.iscsi_write_cache = on {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.iser_helper = tgtadm {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.iser_port = 3260 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.lvm_mirrors = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.lvm_share_target = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.lvm_type = auto {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.num_shell_tries = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.nvmet_port_id = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.replication_device = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.report_discard_supported = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.reserved_percentage = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.scst_target_driver = iscsi {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.scst_target_iqn_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.storage_protocol = iSCSI {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.target_helper = tgtadm {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.target_port = 3260 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.target_protocol = iscsi {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.trace_flags = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.unique_fqdn_network = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.use_chap_auth = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_backend_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_clear = zero {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_clear_ionice = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_clear_size = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack sudo[76822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volume_group = cinder-volumes {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_reports.file_event_handler = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_reports.log_dir = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.backend_availability_zone = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.backend_host = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.chap_password = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.chap_username = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.chiscsi_conf = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.disk_geometry = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.driver_client_cert = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.driver_data_namespace = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.driver_use_ssl = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.extra_capabilities = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.filter_function = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.goodness_function = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.iser_helper = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.iser_ip_address = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.iser_port = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.iser_target_prefix = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.lvm_conf_file = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.lvm_mirrors = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.lvm_share_target = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.lvm_type = auto {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.num_shell_tries = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.nvmet_port_id = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.replication_device = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.report_discard_supported = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.reserved_percentage = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.scst_target_driver = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.storage_protocol = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.target_helper = lioadm {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.target_ip_address = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.target_port = 3260 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.target_protocol = iscsi {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.trace_flags = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.use_chap_auth = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_clear = zero {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_clear_size = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] lvmdriver-1.volumes_dir = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:20 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.ssl = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.ssl_version = {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_notifications.driver = [] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_notifications.retry = -1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] oslo_messaging_notifications.transport_url = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] key_manager.fixed_key = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.barbican_api_version = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.barbican_endpoint = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.barbican_endpoint_type = public {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.barbican_region_name = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.cafile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.certfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.collect_timing = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.insecure = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.keyfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.number_of_retries = 60 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.retry_delay = 1 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.send_service_user_token = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.split_loggers = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.timeout = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.tls_ciphers = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.tls_min_version = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.verify_ssl = True {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican.verify_ssl_path = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.auth_section = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.auth_type = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.cafile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.certfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.collect_timing = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.insecure = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.keyfile = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.split_loggers = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.timeout = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.tls_ciphers = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] barbican_service_user.tls_min_version = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.approle_role_id = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.approle_secret_id = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.auth_method = approle {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.auth_path = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.kv_mountpoint = secret {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.kv_path = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.kv_version = 2 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.namespace = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.root_token_id = **** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.ssl_ca_crt_file = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.timeout = 60.0 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.token_file = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.token_role = None {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.use_ssl = False {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:41:21 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] ******************************************************************************** {{(pid=76654) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 20:41:21 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.389s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:21 devstack sudo[76878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:21 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:21 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.338s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:41:21 devstack cinder-volume[76815]: INFO cinder.brick.local_dev.lvm [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:21 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:41:21 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:21 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG cinder.brick.local_dev.lvm [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76815) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 05 20:41:21 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:21 devstack sudo[77101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:21 devstack sudo[77101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:22 devstack sudo[77101]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:22 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.548s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:22 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:22 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:22 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:22 devstack sudo[77311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:22 devstack sudo[77311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:22 devstack sudo[77311]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:22 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:22 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:22 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:22 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:22 devstack sudo[77432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 05 20:41:22 devstack sudo[77432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:23 devstack sudo[77432]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:23 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.267s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:23 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:23 devstack sudo[77435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:41:23 devstack sudo[77435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:23 devstack sudo[77435]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:23 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:23 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:23 devstack sudo[77519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:41:23 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:23 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:23 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:23 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:23 devstack sudo[77522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:41:23 devstack sudo[77522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:23 devstack sudo[77522]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:23 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:23 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:23 devstack sudo[77576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:23 devstack sudo[77576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:24 devstack sudo[77576]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:24 devstack sudo[77615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:24 devstack sudo[77615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:24 devstack sudo[77615]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:24 devstack cinder-volume[76815]: INFO cinder.volume.drivers.lvm [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:24 devstack sudo[77625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:24 devstack sudo[77625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:24 devstack sudo[77625]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG cinder.volume.drivers.lvm [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Updating volume stats {{(pid=76815) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:41:24 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:24 devstack sudo[77628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:41:24 devstack sudo[77628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:25 devstack sudo[77628]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:25 devstack sudo[77632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:41:25 devstack sudo[77632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:25 devstack sudo[77632]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:25 devstack sudo[77635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:25 devstack sudo[77635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:25 devstack sudo[77635]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:25 devstack sudo[77638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:41:25 devstack sudo[77638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:25 devstack sudo[77638]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:25 devstack cinder-volume[76815]: INFO cinder.volume.driver [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Driver hasn't implemented _init_vendor_properties() Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG cinder.volume.driver [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76815) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_db.sqlalchemy.engines [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG dbcounter [-] [76815] Writer thread running {{(pid=76815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG cinder.db.api [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Building query based on filter {{(pid=76815) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG cinder.image.image_utils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76815) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 20:41:25 devstack cinder-volume[76815]: INFO cinder.keymgr.migration [None req-a33279e9-5fbe-4d35-abd3-06a584d36a86 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG cinder.volume.drivers.lvm [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Updating volume stats {{(pid=76815) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:41:25 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:25 devstack sudo[77641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:41:25 devstack sudo[77641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:26 devstack sudo[77641]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:26 devstack sudo[77645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:41:26 devstack sudo[77645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:26 devstack sudo[77645]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:26 devstack sudo[77649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:26 devstack sudo[77649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:26 devstack sudo[77649]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:26 devstack sudo[77652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:41:26 devstack sudo[77652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:26 devstack sudo[77652]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG cinder.manager [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Notifying Schedulers of capabilities ... {{(pid=76815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:41:26 devstack cinder-volume[76815]: INFO cinder.volume.manager [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Driver initialization completed successfully. Sep 05 20:41:26 devstack cinder-volume[76815]: INFO cinder.manager [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Initiating service 2 cleanup Sep 05 20:41:26 devstack cinder-volume[76815]: INFO cinder.manager [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Service 2 cleanup completed. Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG cinder.service [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Creating RPC server for service cinder-volume {{(pid=76815) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 20:41:26 devstack cinder-volume[76815]: DEBUG cinder.service [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76815) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 20:41:27 devstack cinder-volume[76815]: INFO cinder.volume.manager [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 05 20:41:27 devstack cinder-volume[76815]: DEBUG cinder.volume.drivers.lvm [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Updating volume stats {{(pid=76815) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:41:27 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:27 devstack sudo[77656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:41:27 devstack sudo[77656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:27 devstack sudo[77656]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:27 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:27 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:27 devstack sudo[77659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:41:27 devstack sudo[77659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:27 devstack sudo[77659]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:27 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:27 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:27 devstack sudo[77664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:41:27 devstack sudo[77664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:27 devstack sudo[77664]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:27 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:27 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:41:27 devstack sudo[77670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:41:27 devstack sudo[77670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:41:28 devstack sudo[77670]: pam_unix(sudo:session): session closed for user root Sep 05 20:41:28 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:41:28 devstack cinder-volume[76815]: INFO cinder.volume.manager [None req-940adb99-dbc3-4939-966d-b82864bf550b None None] Driver post RPC initialization completed successfully. Sep 05 20:41:30 devstack cinder-volume[76654]: DEBUG dbcounter [-] [76654] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:41:38 devstack cinder-volume[76815]: DEBUG dbcounter [-] [76815] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:41:38 devstack cinder-volume[76815]: DEBUG dbcounter [-] [76815] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:42:17 devstack cinder-volume[76815]: DEBUG oslo_service.periodic_task [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running periodic task VolumeManager._thread_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:42:17 devstack cinder-volume[76815]: DEBUG cinder.volume.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] thread count: 6 {{(pid=76815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:42:17 devstack cinder-volume[76815]: DEBUG cinder.volume.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] thread info: [<_MainThread(MainThread, started 130176655036544)>, , , , , ] {{(pid=76815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG oslo_service.periodic_task [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG cinder.volume.drivers.lvm [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Updating volume stats {{(pid=76815) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:43:17 devstack sudo[82899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:43:17 devstack sudo[82899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:43:17 devstack sudo[82899]: pam_unix(sudo:session): session closed for user root Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:43:17 devstack sudo[82902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:43:17 devstack sudo[82902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:43:17 devstack sudo[82902]: pam_unix(sudo:session): session closed for user root Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:43:17 devstack sudo[82905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:43:17 devstack sudo[82905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:43:17 devstack sudo[82905]: pam_unix(sudo:session): session closed for user root Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:43:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:43:17 devstack sudo[82908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:43:17 devstack sudo[82908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:43:18 devstack sudo[82908]: pam_unix(sudo:session): session closed for user root Sep 05 20:43:18 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:43:18 devstack cinder-volume[76815]: DEBUG cinder.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Notifying Schedulers of capabilities ... {{(pid=76815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:43:18 devstack cinder-volume[76815]: DEBUG oslo_service.periodic_task [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running periodic task VolumeManager._thread_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:43:18 devstack cinder-volume[76815]: DEBUG cinder.volume.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] thread count: 6 {{(pid=76815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:43:18 devstack cinder-volume[76815]: DEBUG cinder.volume.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] thread info: [<_MainThread(MainThread, started 130176655036544)>, , , , , ] {{(pid=76815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:43:38 devstack cinder-volume[76815]: DEBUG dbcounter [-] [76815] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:44:17 devstack cinder-volume[76815]: DEBUG oslo_service.periodic_task [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:44:17 devstack cinder-volume[76815]: DEBUG cinder.volume.drivers.lvm [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Updating volume stats {{(pid=76815) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:44:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:44:17 devstack sudo[84595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:44:17 devstack sudo[84595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:44:17 devstack sudo[84595]: pam_unix(sudo:session): session closed for user root Sep 05 20:44:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:44:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:44:17 devstack sudo[84609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:44:17 devstack sudo[84609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:44:17 devstack sudo[84609]: pam_unix(sudo:session): session closed for user root Sep 05 20:44:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:44:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:44:17 devstack sudo[84613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:44:17 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:44:18 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root Sep 05 20:44:18 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:44:18 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:44:18 devstack sudo[84635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:44:18 devstack sudo[84635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:44:18 devstack sudo[84635]: pam_unix(sudo:session): session closed for user root Sep 05 20:44:18 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:44:18 devstack cinder-volume[76815]: DEBUG cinder.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Notifying Schedulers of capabilities ... {{(pid=76815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:44:18 devstack cinder-volume[76815]: DEBUG oslo_service.periodic_task [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running periodic task VolumeManager._thread_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:44:18 devstack cinder-volume[76815]: DEBUG cinder.volume.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] thread count: 6 {{(pid=76815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:44:18 devstack cinder-volume[76815]: DEBUG cinder.volume.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] thread info: [<_MainThread(MainThread, started 130176655036544)>, , , , , ] {{(pid=76815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG oslo_service.periodic_task [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG cinder.volume.drivers.lvm [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Updating volume stats {{(pid=76815) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:45:17 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:45:17 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:45:17 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:45:17 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:45:17 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:45:17 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:45:17 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:45:17 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:45:17 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:45:17 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:45:18 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:45:18 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:45:18 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Sep 05 20:45:18 devstack cinder-volume[76815]: DEBUG oslo_concurrency.processutils [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:45:18 devstack cinder-volume[76815]: DEBUG cinder.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Notifying Schedulers of capabilities ... {{(pid=76815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:45:18 devstack cinder-volume[76815]: DEBUG oslo_service.periodic_task [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] Running periodic task VolumeManager._thread_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:45:18 devstack cinder-volume[76815]: DEBUG cinder.volume.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] thread count: 6 {{(pid=76815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:45:18 devstack cinder-volume[76815]: DEBUG cinder.volume.manager [None req-1c659fdc-d154-49fa-9125-b9ab396b4668 None None] thread info: [<_MainThread(MainThread, started 130176655036544)>, , , , , ] {{(pid=76815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:45:38 devstack cinder-volume[76815]: DEBUG dbcounter [-] [76815] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:45:58 devstack cinder-volume[76654]: INFO oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Caught SIGTERM, stopping children Sep 05 20:45:58 devstack cinder-volume[76654]: DEBUG oslo_concurrency.lockutils [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Acquiring lock "singleton_lock" {{(pid=76654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:45:58 devstack cinder-volume[76654]: DEBUG oslo_concurrency.lockutils [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Acquired lock "singleton_lock" {{(pid=76654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:45:58 devstack cinder-volume[76654]: DEBUG oslo_concurrency.lockutils [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Releasing lock "singleton_lock" {{(pid=76654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:45:58 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Stop services. {{(pid=76654) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 20:45:58 devstack cinder-volume[76654]: DEBUG oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Killing children. {{(pid=76654) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 20:45:58 devstack cinder-volume[76654]: INFO oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Waiting on 1 children to exit Sep 05 20:46:02 devstack cinder-volume[76815]: DEBUG oslo_concurrency.lockutils [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Acquiring lock "singleton_lock" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:46:02 devstack cinder-volume[76815]: DEBUG oslo_concurrency.lockutils [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Acquired lock "singleton_lock" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:46:02 devstack cinder-volume[76815]: DEBUG oslo_concurrency.lockutils [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Releasing lock "singleton_lock" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:46:02 devstack cinder-volume[76815]: WARNING amqp [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 20:46:02 devstack cinder-volume[76815]: WARNING amqp [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 20:46:02 devstack cinder-volume[76654]: INFO oslo_service.backend._eventlet.service [None req-8326fc2c-edec-4585-98c6-d07ea2d7073d None None] Child 76815 exited with status 0 Sep 05 20:46:02 devstack cinder-volume[86801]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 20:46:02 devstack cinder-volume[86801]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 20:46:02 devstack cinder-volume[86801]: we strongly recommend against using it for new projects. Sep 05 20:46:02 devstack cinder-volume[86801]: If you are already using Eventlet, we recommend migrating to a different Sep 05 20:46:02 devstack cinder-volume[86801]: framework. For more detail see Sep 05 20:46:02 devstack cinder-volume[86801]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 20:46:02 devstack cinder-volume[86801]: import eventlet # noqa Sep 05 20:46:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:46:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:46:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:46:05 devstack cinder-volume[86801]: INFO dbcounter [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Registered counter for database cinder Sep 05 20:46:05 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:46:05 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writer thread running {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:46:05 devstack cinder-volume[86801]: INFO cinder.rpc [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 20:46:05 devstack cinder-volume[86801]: INFO cinder.rpc [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 20:46:05 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:46:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Determined volume DB was empty at startup. Sep 05 20:46:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86801) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 20:46:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 20:46:05 devstack cinder-volume[86801]: WARNING stevedore.named [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 20:46:05 devstack cinder-volume[86801]: WARNING castellan.key_manager [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:46:05 devstack cinder-volume[86801]: WARNING cinder.keymgr.conf_key_mgr [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:46:06 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:46:06 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Starting 1 workers Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Started child 87021 {{(pid=86801) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Full set of CONF: {{(pid=86801) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] ******************************************************************************** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Configuration options gathered from: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] ================================================================================ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] allow_availability_zone_fallback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] allow_compression_on_image_upload = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] allowed_direct_url_schemes = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] api_rate_limit = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] auth_strategy = keystone {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_stats_polling_interval = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backup_api_class = cinder.backup.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[87021]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backup_name_template = backup-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backup_use_same_host = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backup_use_temp_snapshot = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] chap_username = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_internal_tenant_project_id = d0b64bf38faf444baf5cb6c57ec49b1e {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_internal_tenant_user_id = ecfcec7e697b4b268149bb224869591a {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cluster = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] compression_format = gzip {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] config_dir = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] config_source = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] control_exchange = openstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] debug = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] default_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] default_group_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] default_volume_type = QuobyteHD {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] driver_ssl_cert_verify = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] driver_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] enable_new_services = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] enable_unsupported_driver = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] enforce_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_api_insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_api_ssl_compression = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_ca_certificates_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_num_retries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance_request_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] graceful_shutdown_timeout = 5 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] group_api_class = cinder.group.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] host = devstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_compress_on_upload = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_conversion_address_space_limit = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_conversion_cpu_limit = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_conversion_disable = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_upload_use_cinder_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_upload_use_internal_tenant = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_volume_cache_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_volume_cache_max_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] init_host_max_objects_retrieval = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] instance_format = [instance: %(uuid)s] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] iscsi_target_flags = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] iscsi_write_cache = on {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] iser_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] iser_ip_address = 192.168.122.147 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] iser_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_color = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_config_append = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_options = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_rotate_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_rotate_interval_type = days {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] log_rotation_type = none {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] max_age = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] max_logfile_count = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] max_logfile_size_mb = 200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] max_over_subscription_ratio = 20.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] message_reap_interval = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] message_ttl = 2592000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] monkey_patch = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] monkey_patch_modules = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] my_ip = 192.168.122.147 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] no_snapshot_gb_quota = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] num_iser_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] num_shell_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] num_volume_device_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[87021]: INFO cinder.volume.manager [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.remotefs [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87021) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] nvmeof_conn_info_version = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] nvmet_ns_id = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] nvmet_port_id = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] osapi_max_limit = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] osapi_volume_ext_list = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] osapi_volume_listen_port = 8776 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] osapi_volume_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] osapi_volume_workers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] per_volume_size_limit = -1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] periodic_fuzzy_delay = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] periodic_interval = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] public_endpoint = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] publish_errors = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] quota_backup_gigabytes = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] quota_backups = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] quota_gigabytes = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] quota_groups = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] quota_snapshots = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] quota_volumes = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] rate_limit_burst = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] rate_limit_except_level = CRITICAL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] rate_limit_interval = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] reinit_driver_count = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] report_discard_supported = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] report_interval = 120 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] reservation_clean_interval = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] reservation_expire = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] reserved_image_namespaces = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] reserved_percentage = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] rpc_response_timeout = 120 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] run_external_periodic_tasks = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] scst_target_driver = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_down_time = 720 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] shell_completion = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] snapshot_name_template = snapshot-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] state_path = /opt/stack/data/cinder {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] storage_availability_zone = nova {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] storage_protocol = iSCSI {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] syslog_log_facility = LOG_USER {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] target_helper = lioadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] target_ip_address = 192.168.122.147 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] target_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] target_protocol = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] target_secondary_ip_addresses = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] transport_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] until_refresh = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] use_chap_auth = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] use_default_quota_class = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] use_journal = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] use_json = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] use_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] use_stderr = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] use_syslog = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] verify_glance_signatures = enabled {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_api_class = cinder.volume.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_clear = zero {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_clear_size = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_copy_bps_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_dd_blocksize = 1M {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_name_template = volume-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_service_inithost_offload = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volume_usage_audit_period = month {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] zoning_mode = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.auth_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.interface = public {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87021) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 05 20:46:06 devstack cinder-volume[87021]: WARNING cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 20:46:06 devstack cinder-volume[87021]: WARNING cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Running cmd (subprocess): mount.quobyte {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcache_username = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.service_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.backend = dogpile.cache.null {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.backend_argument = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.backend_expiration_time = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.config_prefix = cache.oslo {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.debug_cache_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.enable_retry_client = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.enable_socket_keepalive = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.expiration_time = 600 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.memcache_dead_retry = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.memcache_sasl_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.proxies = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.redis_db = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.redis_server = localhost:6379 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.retry_attempts = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.retry_delay = 0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.socket_keepalive_count = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.socket_keepalive_idle = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.socket_keepalive_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.socket_timeout = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.tls_allowed_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.tls_cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.tls_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.tls_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.tls_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cache.username = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] coordination.backend_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.asyncio_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.asyncio_slave_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.backend = sqlalchemy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.connection_debug = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.connection_parameters = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.connection_recycle_time = 3600 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.connection_trace = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.db_inc_retry_interval = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.db_max_retries = 20 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.db_max_retry_interval = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.db_retry_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.max_overflow = 50 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.max_pool_size = 5 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.max_retries = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.pool_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.retry_interval = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.slave_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.sqlite_synchronous = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.synchronous_reader = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] database.use_db_reconnect = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_tracing.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.connection_string = messaging:// {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.es_doc_type = notification {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.es_scroll_size = 10000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.es_scroll_time = 2m {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.filter_error_trace = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.hmac_keys = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.sentinel_service_name = mymaster {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.socket_timeout = 0.1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.trace_requests = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler.trace_sqlalchemy = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler_jaeger.process_tags = {} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] profiler_otlp.service_name_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.policy_default_rule = default {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] privsep_osbrick.group = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] privsep_osbrick.helper_command = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] privsep_osbrick.user = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_sys_admin.group = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_sys_admin.helper_command = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] cinder_sys_admin.user = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.send_service_user_token = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.tls_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] service_user.tls_min_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.tls_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] glance.tls_min_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.chap_username = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.driver_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.extra_capabilities = {} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.iscsi_target_flags = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.iser_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_host = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_login = admin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_mount_options = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_private_key = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_share_path = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.report_discard_supported = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.target_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.target_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.target_protocol = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.use_chap_auth = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volume_backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volume_clear = zero {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_reports.file_event_handler = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_reports.log_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.backend_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.chap_username = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.extra_capabilities = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.iser_helper = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.iser_ip_address = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.iser_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_login = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_mount_options = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_private_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_share_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.num_shell_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.report_discard_supported = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.reserved_percentage = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.scst_target_driver = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.storage_protocol = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.target_helper = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.target_ip_address = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.target_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.target_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.target_protocol = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.use_chap_auth = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volume_clear = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volume_clear_size = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] QuobyteHD.volumes_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_notifications.driver = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] key_manager.fixed_key = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.barbican_api_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.barbican_endpoint = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.barbican_endpoint_type = public {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.barbican_region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.number_of_retries = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.retry_delay = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.send_service_user_token = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.tls_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.tls_min_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.verify_ssl = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican.verify_ssl_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.auth_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.tls_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] barbican_service_user.tls_min_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.approle_role_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.approle_secret_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.auth_method = approle {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.auth_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.kv_mountpoint = secret {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.kv_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.kv_version = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.root_token_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.ssl_ca_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.token_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.token_role = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:06 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 -c /etc/quobyte/client-cinder.cfg Sep 05 20:46:06 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] ******************************************************************************** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 20:46:06 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] CMD "mount.quobyte" returned: 1 in 0.147s {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87021) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:46:06 devstack cinder-volume[87021]: INFO cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c ... Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 -c /etc/quobyte/client-cinder.cfg {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:06 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.392s {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:06 devstack cinder-volume[87021]: INFO cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c succeeded Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87021) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.403s {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:46:06 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:06 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:46:06 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:07 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.306s {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:07 devstack cinder-volume[87021]: INFO cinder.volume.driver [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG cinder.volume.driver [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.672607421875, 'free_capacity_gb': 1773.672607421875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87021) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG oslo_db.sqlalchemy.engines [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG dbcounter [-] [87021] Writer thread running {{(pid=87021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG cinder.db.api [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Building query based on filter {{(pid=87021) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG cinder.image.image_utils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87021) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 20:46:07 devstack cinder-volume[87021]: INFO cinder.keymgr.migration [None req-3202e658-e405-4c79-9400-9c33c5f64795 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87021) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87021) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:07 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:46:07 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:07 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.306s {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG cinder.manager [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Notifying Schedulers of capabilities ... {{(pid=87021) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:46:07 devstack cinder-volume[87021]: INFO cinder.volume.manager [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Driver initialization completed successfully. Sep 05 20:46:07 devstack cinder-volume[87021]: INFO cinder.manager [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Initiating service 3 cleanup Sep 05 20:46:07 devstack cinder-volume[87021]: INFO cinder.manager [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Service 3 cleanup completed. Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG cinder.service [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Creating RPC server for service cinder-volume {{(pid=87021) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 20:46:07 devstack cinder-volume[87021]: DEBUG cinder.service [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87021) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 20:46:08 devstack cinder-volume[87021]: INFO cinder.volume.manager [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 05 20:46:08 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:46:08 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:46:08 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87021) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:46:08 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87021) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:46:08 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:46:08 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:08 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:46:08 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:08 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:08 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.504s {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:08 devstack cinder-volume[87021]: INFO cinder.volume.manager [None req-8a1ec570-ee4f-4ca8-b17a-8154d8d61d34 None None] Driver post RPC initialization completed successfully. Sep 05 20:46:12 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-751170f9-4c76-4811-b120-d01d6d9a7825 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:46:12 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-751170f9-4c76-4811-b120-d01d6d9a7825 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:46:12 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-751170f9-4c76-4811-b120-d01d6d9a7825 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87021) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:46:12 devstack cinder-volume[87021]: DEBUG cinder.volume.drivers.quobyte [None req-751170f9-4c76-4811-b120-d01d6d9a7825 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87021) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:46:12 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-751170f9-4c76-4811-b120-d01d6d9a7825 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87021) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:46:12 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-751170f9-4c76-4811-b120-d01d6d9a7825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:12 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:46:12 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:12 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:12 devstack cinder-volume[87021]: DEBUG oslo_concurrency.processutils [None req-751170f9-4c76-4811-b120-d01d6d9a7825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.291s {{(pid=87021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:12 devstack cinder-volume[87021]: DEBUG cinder.manager [None req-751170f9-4c76-4811-b120-d01d6d9a7825 None None] Notifying Schedulers of capabilities ... {{(pid=87021) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:46:13 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Caught SIGTERM, stopping children Sep 05 20:46:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Acquiring lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:46:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Acquired lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:46:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Releasing lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:46:13 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Stop services. {{(pid=86801) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 20:46:13 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Killing children. {{(pid=86801) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 20:46:13 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Waiting on 1 children to exit Sep 05 20:46:16 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Acquiring lock "singleton_lock" {{(pid=87021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:46:16 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Acquired lock "singleton_lock" {{(pid=87021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:46:16 devstack cinder-volume[87021]: DEBUG oslo_concurrency.lockutils [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Releasing lock "singleton_lock" {{(pid=87021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:46:16 devstack cinder-volume[87021]: WARNING amqp [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 20:46:16 devstack cinder-volume[87021]: WARNING amqp [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 20:46:16 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-8554e8cd-67cc-4beb-8019-ace7f954c8f7 None None] Child 87021 exited with status 0 Sep 05 20:46:17 devstack cinder-volume[87467]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 20:46:17 devstack cinder-volume[87467]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 20:46:17 devstack cinder-volume[87467]: we strongly recommend against using it for new projects. Sep 05 20:46:17 devstack cinder-volume[87467]: If you are already using Eventlet, we recommend migrating to a different Sep 05 20:46:17 devstack cinder-volume[87467]: framework. For more detail see Sep 05 20:46:17 devstack cinder-volume[87467]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 20:46:17 devstack cinder-volume[87467]: import eventlet # noqa Sep 05 20:46:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:46:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:46:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:46:21 devstack cinder-volume[87467]: INFO dbcounter [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Registered counter for database cinder Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writer thread running {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:46:21 devstack cinder-volume[87467]: INFO cinder.rpc [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 20:46:21 devstack cinder-volume[87467]: INFO cinder.rpc [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:46:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Determined volume DB was empty at startup. Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87467) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 20:46:21 devstack cinder-volume[87467]: WARNING stevedore.named [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 20:46:21 devstack cinder-volume[87467]: WARNING castellan.key_manager [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:46:21 devstack cinder-volume[87467]: WARNING cinder.keymgr.conf_key_mgr [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:46:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:46:21 devstack cinder-volume[87467]: INFO oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Starting 1 workers Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Started child 87802 {{(pid=87467) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Full set of CONF: {{(pid=87467) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] ******************************************************************************** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] Configuration options gathered from: {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] ================================================================================ {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] allow_availability_zone_fallback = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] allow_compression_on_image_upload = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] allowed_direct_url_schemes = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] api_rate_limit = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] auth_strategy = keystone {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_availability_zone = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_host = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:21 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_stats_polling_interval = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backup_api_class = cinder.backup.api.API {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87802]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backup_name_template = backup-%s {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backup_use_same_host = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backup_use_temp_snapshot = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] chap_password = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] chap_username = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_internal_tenant_project_id = d0b64bf38faf444baf5cb6c57ec49b1e {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_internal_tenant_user_id = ecfcec7e697b4b268149bb224869591a {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cluster = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] compression_format = gzip {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] compute_api_class = cinder.compute.nova.API {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] config_dir = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] config_source = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] control_exchange = openstack {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] debug = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] default_availability_zone = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] default_group_type = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] default_volume_type = QuobyteHD {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] disk_geometry = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] driver_client_cert = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] driver_client_cert_key = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] driver_data_namespace = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] driver_ssl_cert_path = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] driver_ssl_cert_verify = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] driver_use_ssl = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] enable_new_services = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] enable_unsupported_driver = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] enabled_backends = ['QuobyteHD'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] enforce_multipath_for_image_xfer = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] filter_function = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_api_insecure = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_api_ssl_compression = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_ca_certificates_file = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_catalog_info = image:glance:publicURL {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_certfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_keyfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_num_retries = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance_request_timeout = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] goodness_function = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] graceful_shutdown_timeout = 5 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] group_api_class = cinder.group.api.API {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] host = devstack {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_compress_on_upload = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_conversion_address_space_limit = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_conversion_cpu_limit = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_conversion_disable = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_upload_use_cinder_backend = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_upload_use_internal_tenant = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_volume_cache_enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_volume_cache_max_count = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] image_volume_cache_max_size_gb = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] init_host_max_objects_retrieval = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] instance_format = [instance: %(uuid)s] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] iscsi_target_flags = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] iscsi_write_cache = on {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] iser_helper = tgtadm {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] iser_ip_address = 192.168.122.147 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] iser_port = 3260 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_color = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_config_append = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_dir = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_file = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_options = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_rotate_interval = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_rotate_interval_type = days {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] log_rotation_type = none {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] max_age = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] max_logfile_count = 30 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] max_logfile_size_mb = 200 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] max_over_subscription_ratio = 20.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] message_reap_interval = 86400 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] message_ttl = 2592000 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] migration_create_volume_timeout_secs = 300 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] monkey_patch = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] monkey_patch_modules = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] my_ip = 192.168.122.147 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] no_snapshot_gb_quota = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] num_iser_scan_tries = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] num_shell_tries = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] num_volume_device_scan_tries = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] nvmeof_conn_info_version = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] nvmet_ns_id = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] nvmet_port_id = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] osapi_max_limit = 1000 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] osapi_volume_ext_list = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] osapi_volume_listen = 0.0.0.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] osapi_volume_listen_port = 8776 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] osapi_volume_use_ssl = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] osapi_volume_workers = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] per_volume_size_limit = -1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] periodic_fuzzy_delay = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] periodic_interval = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] project_id_regex = [0-9a-f\-]+ {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] public_endpoint = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] publish_errors = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] quota_backup_gigabytes = 1000 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] quota_backups = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] quota_gigabytes = 1000 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] quota_groups = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] quota_snapshots = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] quota_volumes = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] rate_limit_burst = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] rate_limit_except_level = CRITICAL {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] rate_limit_interval = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] reinit_driver_count = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] replication_device = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] report_discard_supported = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] report_interval = 120 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] reservation_clean_interval = 86400 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] reservation_expire = 86400 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] reserved_image_namespaces = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] reserved_percentage = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] rpc_response_timeout = 120 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] run_external_periodic_tasks = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] scst_target_driver = iscsi {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] scst_target_iqn_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_down_time = 720 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] shell_completion = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] snapshot_name_template = snapshot-%s {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] split_loggers = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] state_path = /opt/stack/data/cinder {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] storage_availability_zone = nova {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] storage_protocol = iSCSI {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] syslog_log_facility = LOG_USER {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] target_helper = lioadm {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] target_ip_address = 192.168.122.147 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] target_port = 3260 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] target_protocol = iscsi {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] target_secondary_ip_addresses = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] trace_flags = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] transfer_api_class = cinder.transfer.api.API {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] transport_url = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] until_refresh = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] use_chap_auth = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] use_default_quota_class = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] use_journal = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] use_json = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] use_multipath_for_image_xfer = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] use_stderr = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] use_syslog = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] verify_glance_signatures = enabled {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_api_class = cinder.volume.api.API {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_backend_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_clear = zero {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_clear_ionice = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_clear_size = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_copy_bps_limit = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_dd_blocksize = 1M {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_name_template = volume-%s {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_service_inithost_offload = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volume_usage_audit_period = month {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] zoning_mode = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_concurrency.disable_process_locking = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.auth_section = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.auth_type = password {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.auth_version = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.cache = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.certfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.delay_auth_decision = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.http_connect_timeout = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.include_service_catalog = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.insecure = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.interface = public {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.keyfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_password = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87802) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcache_username = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.region_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.service_token_roles_required = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.service_type = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.token_cache_time = 300 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.backend = dogpile.cache.null {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.backend_argument = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.backend_expiration_time = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.config_prefix = cache.oslo {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.debug_cache_backend = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.enable_retry_client = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.enable_socket_keepalive = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.expiration_time = 600 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.hashclient_retry_attempts = 2 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.memcache_dead_retry = 300 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.memcache_pool_maxsize = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.memcache_sasl_enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.password = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.proxies = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.redis_db = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.redis_sentinel_service_name = mymaster {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.redis_server = localhost:6379 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.retry_attempts = 2 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.retry_delay = 0.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.socket_keepalive_count = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.socket_keepalive_idle = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.socket_keepalive_interval = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.socket_timeout = 1.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.tls_allowed_ciphers = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.tls_cafile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.tls_certfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.tls_enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.tls_keyfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cache.username = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] coordination.backend_url = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.asyncio_connection = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.asyncio_slave_connection = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.backend = sqlalchemy {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.connection = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.connection_debug = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.connection_parameters = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.connection_recycle_time = 3600 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.connection_trace = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.db_inc_retry_interval = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.db_max_retries = 20 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.db_max_retry_interval = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.db_retry_interval = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.max_overflow = 50 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.max_pool_size = 5 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.max_retries = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.mysql_wsrep_sync_wait = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.pool_timeout = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.retry_interval = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.slave_connection = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.sqlite_synchronous = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.synchronous_reader = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] database.use_db_reconnect = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_tracing.insecure = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.connection_string = messaging:// {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.es_doc_type = notification {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.es_scroll_size = 10000 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.es_scroll_time = 2m {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.filter_error_trace = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.hmac_keys = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.sentinel_service_name = mymaster {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.socket_timeout = 0.1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.trace_requests = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler.trace_sqlalchemy = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler_jaeger.process_tags = {} {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler_jaeger.service_name_prefix = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] profiler_otlp.service_name_prefix = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.enforce_new_defaults = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.policy_default_rule = default {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.policy_file = policy.yaml {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_policy.remote_timeout = 60.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] privsep_osbrick.group = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] privsep_osbrick.helper_command = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] privsep_osbrick.user = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_sys_admin.group = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_sys_admin.helper_command = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] cinder_sys_admin.user = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.auth_section = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.auth_type = password {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.cafile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.certfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.collect_timing = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.insecure = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.keyfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.send_service_user_token = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.split_loggers = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.timeout = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.tls_ciphers = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] service_user.tls_min_version = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.auth_section = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.auth_type = password {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.certfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.collect_timing = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.insecure = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.keyfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.region_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.split_loggers = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.timeout = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.tls_ciphers = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] glance.tls_min_version = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.backend_availability_zone = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.chap_password = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.chap_username = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.disk_geometry = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.driver_client_cert = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.driver_client_cert_key = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.driver_data_namespace = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.driver_use_ssl = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.enable_unsupported_driver = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.extra_capabilities = {} {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.filter_function = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.goodness_function = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.iscsi_target_flags = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.iscsi_write_cache = on {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.iser_helper = tgtadm {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.iser_port = 3260 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_host = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_login = admin {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_mount_options = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_password = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_private_key = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_share_path = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_ssh_port = 22 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.num_shell_tries = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.nvmet_port_id = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.quobyte_client_cfg = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.quobyte_volume_url = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.replication_device = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.report_discard_supported = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.reserved_percentage = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.scst_target_driver = iscsi {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.scst_target_iqn_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.storage_protocol = iSCSI {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.target_helper = tgtadm {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.target_port = 3260 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.target_protocol = iscsi {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.trace_flags = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.unique_fqdn_network = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.use_chap_auth = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volume_backend_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volume_clear = zero {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volume_clear_ionice = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volume_clear_size = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87802) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 05 20:46:22 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 20:46:22 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_reports.file_event_handler = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_reports.log_dir = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.backend_availability_zone = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.backend_host = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Running cmd (subprocess): mount.quobyte {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.chap_password = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.chap_username = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.chiscsi_conf = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.disk_geometry = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.driver_client_cert = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.driver_client_cert_key = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.driver_data_namespace = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.driver_use_ssl = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.extra_capabilities = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.filter_function = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.goodness_function = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.iscsi_target_flags = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.iscsi_write_cache = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.iser_helper = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.iser_ip_address = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.iser_port = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.iser_target_prefix = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_host = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_login = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_mount_options = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_password = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_private_key = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_share_path = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_ssh_port = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.num_shell_tries = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nvmet_ns_id = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.nvmet_port_id = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.replication_device = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.report_discard_supported = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.reserved_percentage = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.scst_target_driver = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.storage_protocol = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.target_helper = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.target_ip_address = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.target_port = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.target_prefix = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.target_protocol = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.trace_flags = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.unique_fqdn_network = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.use_chap_auth = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volume_clear = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volume_clear_ionice = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volume_clear_size = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] QuobyteHD.volumes_dir = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.ssl = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.ssl_version = {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_notifications.driver = [] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_notifications.retry = -1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] oslo_messaging_notifications.transport_url = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] key_manager.fixed_key = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.barbican_api_version = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.barbican_endpoint = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.barbican_endpoint_type = public {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.barbican_region_name = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.cafile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.certfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.collect_timing = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.insecure = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.keyfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.number_of_retries = 60 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.retry_delay = 1 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.send_service_user_token = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.split_loggers = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.timeout = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.tls_ciphers = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.tls_min_version = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.verify_ssl = True {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican.verify_ssl_path = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.auth_section = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.auth_type = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.cafile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.certfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.collect_timing = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.insecure = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.keyfile = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.split_loggers = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.timeout = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.tls_ciphers = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] barbican_service_user.tls_min_version = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.approle_role_id = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.approle_secret_id = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.auth_method = approle {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.auth_path = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.kv_mountpoint = secret {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.kv_path = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.kv_version = 2 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.namespace = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.root_token_id = **** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.ssl_ca_crt_file = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.timeout = 60.0 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.token_file = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.token_role = None {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.use_ssl = False {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:46:22 devstack cinder-volume[87467]: DEBUG oslo_service.backend._eventlet.service [None req-a2d12144-d65a-4729-ad22-9c57ff88459b None None] ******************************************************************************** {{(pid=87467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 20:46:22 devstack quobyte-client[87804]: Reading configuration file: /etc/quobyte/client.cfg Sep 05 20:46:22 devstack quobyte-client[87804]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:22 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:46:22 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:22 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.254s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:22 devstack cinder-volume[87802]: INFO cinder.volume.driver [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.volume.driver [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.672607421875, 'free_capacity_gb': 1773.672607421875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87802) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_db.sqlalchemy.engines [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87802) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writer thread running {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.db.api [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Building query based on filter {{(pid=87802) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87802) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:46:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:22 devstack cinder-volume[87802]: INFO cinder.keymgr.migration [None req-0a5b35b7-3a07-46e7-b9e6-8c8f8a8dca59 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 20:46:22 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:46:22 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:23 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.365s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:46:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Driver initialization completed successfully. Sep 05 20:46:23 devstack cinder-volume[87802]: INFO cinder.manager [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Initiating service 3 cleanup Sep 05 20:46:23 devstack cinder-volume[87802]: INFO cinder.manager [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Service 3 cleanup completed. Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG cinder.service [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Creating RPC server for service cinder-volume {{(pid=87802) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG cinder.service [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87802) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 20:46:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:23 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:46:23 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:23 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.305s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d4753004-84bb-4660-8f48-f299193fa913 None None] Driver post RPC initialization completed successfully. Sep 05 20:46:31 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:46:33 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:46:33 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=3 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:46:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:46:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 6 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:46:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Flow 'volume_create_manager' (3a7e40e8-b711-4d6e-bfd3-7cc155fafbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91932ed2-91ce-4984-981a-77056a276e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91932ed2-91ce-4984-981a-77056a276e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1116816609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee66bcc-be5e-443b-8027-161c2f05e7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3715ec559764c8f9020873ff2787c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:47:53Z,use_quota=True,user_id='a1e1243f32f741d192b698f085a15c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c016f8-21fc-447c-b324-378558aaa4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c016f8-21fc-447c-b324-378558aaa4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b553880f-5e9c-4500-b226-f9e68886a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b553880f-5e9c-4500-b226-f9e68886a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee66bcc-be5e-443b-8027-161c2f05e7bc', 'volume_name': 'volume-aee66bcc-be5e-443b-8027-161c2f05e7bc', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5455235e-10ea-4904-a368-df8b08b5a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5455235e-10ea-4904-a368-df8b08b5a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c484b9d3-59d7-4bcf-92fd-25ca2a799653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:47:53 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Volume aee66bcc-be5e-443b-8027-161c2f05e7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee66bcc-be5e-443b-8027-161c2f05e7bc', 'volume_size': 1} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1116816609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee66bcc-be5e-443b-8027-161c2f05e7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3715ec559764c8f9020873ff2787c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:47:53Z,use_quota=True,user_id='a1e1243f32f741d192b698f085a15c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Creating volume aee66bcc-be5e-443b-8027-161c2f05e7bc {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:47:53 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:47:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:53 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc 1073741824 Sep 05 20:47:53 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:54 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc 1073741824" returned: 0 in 0.881s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:54 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc Sep 05 20:47:54 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:55 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc" returned: 0 in 0.419s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c484b9d3-59d7-4bcf-92fd-25ca2a799653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee66bcc-be5e-443b-8027-161c2f05e7bc', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0e8c54-8f7d-430e-a45a-3bd8e1c63e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:47:55 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Volume volume-aee66bcc-be5e-443b-8027-161c2f05e7bc (aee66bcc-be5e-443b-8027-161c2f05e7bc): created successfully Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0e8c54-8f7d-430e-a45a-3bd8e1c63e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Flow 'volume_create_manager' (3a7e40e8-b711-4d6e-bfd3-7cc155fafbe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:47:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8a422201-00a9-4fff-aef4-88498fd24e06 tempest-VolumesAdminNegativeTest-1433587761 None] Created volume successfully. Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:55 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:47:55 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:56 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.396s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:47:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:47:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 6 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:47:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:47:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Acquiring lock "cinder-aee66bcc-be5e-443b-8027-161c2f05e7bc-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:47:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "cinder-aee66bcc-be5e-443b-8027-161c2f05e7bc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:47:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Acquiring lock "cinder-quobyte-aee66bcc-be5e-443b-8027-161c2f05e7bc" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:47:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "cinder-quobyte-aee66bcc-be5e-443b-8027-161c2f05e7bc" acquired by "delete_volume" :: waited 0.038s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:47:57 devstack cinder-volume[87802]: INFO oslo.privsep.daemon [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5rfa9lx5/privsep.sock'] Sep 05 20:47:57 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5rfa9lx5/privsep.sock Sep 05 20:47:57 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 20:47:59 devstack cinder-volume[87802]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 05 20:47:59 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:59 devstack cinder-volume[87802]: INFO oslo.privsep.daemon [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Spawned new privsep daemon via rootwrap Sep 05 20:47:59 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Accepted privsep connection to /tmp/tmp5rfa9lx5/privsep.sock {{(pid=87802) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 05 20:47:59 devstack cinder-volume[87802]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 05 20:47:59 devstack cinder-volume[87802]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 05 20:47:59 devstack cinder-volume[87802]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 05 20:47:59 devstack cinder-volume[87802]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88769 Sep 05 20:47:59 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e642d2b-a208-49bc-936c-fc96b24161d6]: (2,) {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:47:59 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f2d322-c0b3-4a70-bc09-ef654ba291d1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:47:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:59 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc Sep 05 20:47:59 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:00 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc" returned: 0 in 0.679s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:00 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc Sep 05 20:48:00 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:00 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-aee66bcc-be5e-443b-8027-161c2f05e7bc" returned: 0 in 0.645s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "cinder-quobyte-aee66bcc-be5e-443b-8027-161c2f05e7bc" released by "delete_volume" :: held 3.077s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:00 devstack cinder-volume[87802]: WARNING cinder.quota [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:48:00 devstack cinder-volume[87802]: WARNING cinder.quota [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:48:00 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Created reservations ['1a64db1d-1b45-4aac-a5a1-982bd35c3196', '364d1038-0931-487b-bc06-9c862ba57f85', '139436d1-316c-4706-a3e0-c6115e94919c', '3a5c0ab1-4f06-45cf-aacd-1e15410bfd46'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:01 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:48:01 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:01 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.634s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:48:01 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Deleted volume successfully. Sep 05 20:48:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-de52375e-0941-4df3-8416-4bda851d9e73 tempest-VolumesAdminNegativeTest-1433587761 None] Lock "cinder-aee66bcc-be5e-443b-8027-161c2f05e7bc-delete_volume" released by "delete_volume" :: held 4.304s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:11 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:48:11 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=12,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Flow 'volume_create_manager' (4d8e4c4b-502e-46a5-973e-8df523b41304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069d729e-8577-4908-a574-d272a36b4e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069d729e-8577-4908-a574-d272a36b4e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1089902049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc6a303-a3b2-40d8-91d4-921705f4eec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa10f8912ae0416993dadb6b89aefa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:23Z,use_quota=True,user_id='924c0034396c4f6ba234357470fbc817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825fd44a-c9a8-4ca8-8ccb-f9b909fe84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825fd44a-c9a8-4ca8-8ccb-f9b909fe84c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12188fcb-5ba6-4528-8755-01dbdf1c0612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12188fcb-5ba6-4528-8755-01dbdf1c0612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc6a303-a3b2-40d8-91d4-921705f4eec7', 'volume_name': 'volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46e335d-5946-4328-9651-42cc71cfb819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46e335d-5946-4328-9651-42cc71cfb819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb38fad-417c-4d1f-a342-ed6e0f83cc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:22 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Volume 9dc6a303-a3b2-40d8-91d4-921705f4eec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7', 'volume_size': 1} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1089902049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc6a303-a3b2-40d8-91d4-921705f4eec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa10f8912ae0416993dadb6b89aefa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:23Z,use_quota=True,user_id='924c0034396c4f6ba234357470fbc817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Creating volume 9dc6a303-a3b2-40d8-91d4-921705f4eec7 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:48:22 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:48:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:22 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 1073741824 Sep 05 20:48:22 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:23 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 1073741824" returned: 0 in 0.745s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:23 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 Sep 05 20:48:23 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Flow 'volume_create_manager' (d5b7b171-caf3-498b-80f5-048642f66056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486226dd-bcc2-4501-b8db-b801b9b548d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486226dd-bcc2-4501-b8db-b801b9b548d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1501103510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f9516b-560e-46e1-90f7-d325c0691fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144abfafdee448d492feeb8b5db690be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:24Z,use_quota=True,user_id='bcd2c6a5f8ec4bfbb915689d1422e5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:24 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebbd1ef-63d5-4b5f-a22d-a735f6b64146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebbd1ef-63d5-4b5f-a22d-a735f6b64146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d32993-4acc-465a-a61e-7052dcf72552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d32993-4acc-465a-a61e-7052dcf72552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f9516b-560e-46e1-90f7-d325c0691fc7', 'volume_name': 'volume-d2f9516b-560e-46e1-90f7-d325c0691fc7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5856d931-d94f-47d3-9c22-b14082619eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5856d931-d94f-47d3-9c22-b14082619eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92970450-3389-4650-b1b3-96c82731df22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Volume d2f9516b-560e-46e1-90f7-d325c0691fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f9516b-560e-46e1-90f7-d325c0691fc7', 'volume_size': 1} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7" returned: 0 in 0.415s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1501103510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f9516b-560e-46e1-90f7-d325c0691fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144abfafdee448d492feeb8b5db690be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:24Z,use_quota=True,user_id='bcd2c6a5f8ec4bfbb915689d1422e5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Creating volume d2f9516b-560e-46e1-90f7-d325c0691fc7 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:48:24 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb38fad-417c-4d1f-a342-ed6e0f83cc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a2cb6c-3c5b-4286-af97-846cb97c8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:24 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 1073741824 Sep 05 20:48:24 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Volume volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 (9dc6a303-a3b2-40d8-91d4-921705f4eec7): created successfully Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a2cb6c-3c5b-4286-af97-846cb97c8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Flow 'volume_create_manager' (4d8e4c4b-502e-46a5-973e-8df523b41304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:24 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-70451fad-2a4e-4fad-85b4-70a3dd602bbe tempest-DeleteServersTestJSON-1319453100 None] Created volume successfully. Sep 05 20:48:24 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 1073741824" returned: 0 in 0.797s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:25 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 Sep 05 20:48:25 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:25 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7" returned: 0 in 0.620s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:48:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92970450-3389-4650-b1b3-96c82731df22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f9516b-560e-46e1-90f7-d325c0691fc7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bc62b2-7d81-4163-a938-1c0143a7af67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:25 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Volume volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 (d2f9516b-560e-46e1-90f7-d325c0691fc7): created successfully Sep 05 20:48:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bc62b2-7d81-4163-a938-1c0143a7af67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Flow 'volume_create_manager' (d5b7b171-caf3-498b-80f5-048642f66056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:25 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fae8bad6-16e3-4b68-99b1-abf6ef7a9189 tempest-ServerActionsTestOtherA-839199023 None] Created volume successfully. Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Flow 'volume_create_manager' (7df15c90-b068-46fe-a854-a477a24c04ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d9e576-031d-473a-b802-f44580ad7888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d9e576-031d-473a-b802-f44580ad7888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1212912475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf95a7c-7c3b-4075-8600-a9363d2150fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef4c372ee8b4d578a07f56a9f9e850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:27Z,use_quota=True,user_id='e7adce3943ea457590f9bcf397209347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1415b8d2-ffa7-469f-b703-e9f885df7154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1415b8d2-ffa7-469f-b703-e9f885df7154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e53f8-ac9d-4ac7-97ac-fa697b3ec4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e53f8-ac9d-4ac7-97ac-fa697b3ec4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf95a7c-7c3b-4075-8600-a9363d2150fd', 'volume_name': 'volume-acf95a7c-7c3b-4075-8600-a9363d2150fd', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75eff35-b67f-4e5f-ab55-ca3e92f9dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75eff35-b67f-4e5f-ab55-ca3e92f9dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96c047b-ca05-44fb-bfb1-9c8e4e29f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:27 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Volume acf95a7c-7c3b-4075-8600-a9363d2150fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf95a7c-7c3b-4075-8600-a9363d2150fd', 'volume_size': 1} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1212912475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf95a7c-7c3b-4075-8600-a9363d2150fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef4c372ee8b4d578a07f56a9f9e850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:27Z,use_quota=True,user_id='e7adce3943ea457590f9bcf397209347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Creating volume acf95a7c-7c3b-4075-8600-a9363d2150fd {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:48:27 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:27 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd 1073741824 Sep 05 20:48:27 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:27 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd 1073741824" returned: 0 in 0.736s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:28 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd Sep 05 20:48:28 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:28 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:48:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96c047b-ca05-44fb-bfb1-9c8e4e29f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf95a7c-7c3b-4075-8600-a9363d2150fd', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0f04fb-3f1b-4518-9563-7b2c9f7598d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:28 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Volume volume-acf95a7c-7c3b-4075-8600-a9363d2150fd (acf95a7c-7c3b-4075-8600-a9363d2150fd): created successfully Sep 05 20:48:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0f04fb-3f1b-4518-9563-7b2c9f7598d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Flow 'volume_create_manager' (7df15c90-b068-46fe-a854-a477a24c04ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-793ef56c-0121-4185-b95b-c9b91382c9fb tempest-AttachVolumeNegativeTest-1302627189 None] Created volume successfully. Sep 05 20:48:29 devstack cinder-volume[87802]: WARNING py.warnings [req-7d39bf7e-d837-44fd-a422-a67afac8700a req-9f88d14f-0ca1-49a6-81b9-1f208a9b2bc4 tempest-DeleteServersTestJSON-1319453100 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 05 20:48:29 devstack cinder-volume[87802]: .first() Sep 05 20:48:29 devstack cinder-volume[87802]: Sep 05 20:48:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-7d39bf7e-d837-44fd-a422-a67afac8700a req-9f88d14f-0ca1-49a6-81b9-1f208a9b2bc4 tempest-DeleteServersTestJSON-1319453100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-7d39bf7e-d837-44fd-a422-a67afac8700a req-9f88d14f-0ca1-49a6-81b9-1f208a9b2bc4 tempest-DeleteServersTestJSON-1319453100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-7d39bf7e-d837-44fd-a422-a67afac8700a req-9f88d14f-0ca1-49a6-81b9-1f208a9b2bc4 tempest-DeleteServersTestJSON-1319453100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-7d39bf7e-d837-44fd-a422-a67afac8700a req-9f88d14f-0ca1-49a6-81b9-1f208a9b2bc4 tempest-DeleteServersTestJSON-1319453100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd11d04f1-ec00-4fc8-a489-4d74b982f1dd', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:48:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-7d39bf7e-d837-44fd-a422-a67afac8700a req-9f88d14f-0ca1-49a6-81b9-1f208a9b2bc4 tempest-DeleteServersTestJSON-1319453100 None] attachment_update completed successfully. Sep 05 20:48:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-3809cfbc-617c-42f7-ad26-354b62c74d96 req-55852119-308b-4bc0-922d-59ae74cb33c2 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-3809cfbc-617c-42f7-ad26-354b62c74d96 req-55852119-308b-4bc0-922d-59ae74cb33c2 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-3809cfbc-617c-42f7-ad26-354b62c74d96 req-55852119-308b-4bc0-922d-59ae74cb33c2 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-3809cfbc-617c-42f7-ad26-354b62c74d96 req-55852119-308b-4bc0-922d-59ae74cb33c2 tempest-AttachVolumeNegativeTest-1302627189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-acf95a7c-7c3b-4075-8600-a9363d2150fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11357c21-3be8-47d4-8e15-b0427e958794', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:48:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-3809cfbc-617c-42f7-ad26-354b62c74d96 req-55852119-308b-4bc0-922d-59ae74cb33c2 tempest-AttachVolumeNegativeTest-1302627189 None] attachment_update completed successfully. Sep 05 20:48:37 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-4f19cd80-9ec6-4b48-ae81-a8641cb56b05 req-31f44cbf-0090-4fbd-b5de-fe1cd79f58bb tempest-DeleteServersTestJSON-1319453100 None] Terminate volume connection completed successfully. Sep 05 20:48:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-4f19cd80-9ec6-4b48-ae81-a8641cb56b05 req-31f44cbf-0090-4fbd-b5de-fe1cd79f58bb tempest-DeleteServersTestJSON-1319453100 None] Deleting attachment d11d04f1-ec00-4fc8-a489-4d74b982f1dd. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:48:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Acquiring lock "cinder-9dc6a303-a3b2-40d8-91d4-921705f4eec7-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:48:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Lock "cinder-9dc6a303-a3b2-40d8-91d4-921705f4eec7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:48:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Acquiring lock "cinder-quobyte-9dc6a303-a3b2-40d8-91d4-921705f4eec7" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:48:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Lock "cinder-quobyte-9dc6a303-a3b2-40d8-91d4-921705f4eec7" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:48:40 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2986ddb7-381c-4c5f-b790-9f0e9f52e992]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:48:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:40 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 Sep 05 20:48:40 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:41 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7" returned: 0 in 0.742s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:41 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7 Sep 05 20:48:41 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:41 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9dc6a303-a3b2-40d8-91d4-921705f4eec7" returned: 0 in 0.513s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Lock "cinder-quobyte-9dc6a303-a3b2-40d8-91d4-921705f4eec7" released by "delete_volume" :: held 1.329s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:41 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Created reservations ['6069592f-4e8a-4f23-a530-54c43bb2fabd', 'afd82ae3-3f02-4565-aa4f-5b3ec0358356', 'c1f9a48c-6b35-4fcf-bf41-4db19fb33465', '94e61ed2-7cc0-461b-a0cf-96b66c7cfa91'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:42 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:48:42 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:42 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.365s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:48:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Deleted volume successfully. Sep 05 20:48:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-85df6ce8-edd9-4bc7-8854-3ff3d013e75b tempest-DeleteServersTestJSON-1319453100 None] Lock "cinder-9dc6a303-a3b2-40d8-91d4-921705f4eec7-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:52 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=32,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:48:52 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:55 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:48:55 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:55 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.376s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:48:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:48:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 8 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:48:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:49:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-512fccdd-0d2b-4241-b70a-174f683c045f req-49d7affb-3774-471c-ab14-b541455d012b tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-512fccdd-0d2b-4241-b70a-174f683c045f req-49d7affb-3774-471c-ab14-b541455d012b tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-512fccdd-0d2b-4241-b70a-174f683c045f req-49d7affb-3774-471c-ab14-b541455d012b tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-512fccdd-0d2b-4241-b70a-174f683c045f req-49d7affb-3774-471c-ab14-b541455d012b tempest-ServerActionsTestOtherA-839199023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-d2f9516b-560e-46e1-90f7-d325c0691fc7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86b7768c-4666-4ef1-9f40-e5ad849dfe94', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:49:12 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-512fccdd-0d2b-4241-b70a-174f683c045f req-49d7affb-3774-471c-ab14-b541455d012b tempest-ServerActionsTestOtherA-839199023 None] attachment_update completed successfully. Sep 05 20:49:16 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:49:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Flow 'volume_create_manager' (58b7617b-2627-4927-808f-57ab04486434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11c3650-45da-4124-a38d-c2ae56dcb848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11c3650-45da-4124-a38d-c2ae56dcb848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-826200291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab32dda2-a53a-4295-9111-7ff217ca00fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf09f842f95a4947880a8d54d021b0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:17Z,use_quota=True,user_id='39ddb1c58ee54942bd1ddefcc69a1d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8c00d4-222c-4e2a-8fb9-6d2292f6f35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8c00d4-222c-4e2a-8fb9-6d2292f6f35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b09908-123f-4c0e-844c-9075e1ba6830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b09908-123f-4c0e-844c-9075e1ba6830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab32dda2-a53a-4295-9111-7ff217ca00fa', 'volume_name': 'volume-ab32dda2-a53a-4295-9111-7ff217ca00fa', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fe2c39-d2ab-4914-b4f9-c45f40b148a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fe2c39-d2ab-4914-b4f9-c45f40b148a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34eca7b-0be3-415d-8ba5-b1c8b90ed0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:17 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Volume ab32dda2-a53a-4295-9111-7ff217ca00fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab32dda2-a53a-4295-9111-7ff217ca00fa', 'volume_size': 1} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-826200291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab32dda2-a53a-4295-9111-7ff217ca00fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf09f842f95a4947880a8d54d021b0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:17Z,use_quota=True,user_id='39ddb1c58ee54942bd1ddefcc69a1d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Creating volume ab32dda2-a53a-4295-9111-7ff217ca00fa {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:49:17 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:17 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa 1073741824 Sep 05 20:49:17 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:17 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa 1073741824" returned: 0 in 0.781s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:17 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa Sep 05 20:49:17 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:18 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa" returned: 0 in 0.449s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:49:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34eca7b-0be3-415d-8ba5-b1c8b90ed0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab32dda2-a53a-4295-9111-7ff217ca00fa', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6126a4-7bb9-4703-852a-705c6e153303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-8996360d-3515-481c-a443-1515955ea25a req-a66611fc-27e5-4f3a-87b4-21c0d5a56b29 tempest-ServerActionsTestOtherA-839199023 None] Terminate volume connection completed successfully. Sep 05 20:49:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-8996360d-3515-481c-a443-1515955ea25a req-a66611fc-27e5-4f3a-87b4-21c0d5a56b29 tempest-ServerActionsTestOtherA-839199023 None] Deleting attachment 86b7768c-4666-4ef1-9f40-e5ad849dfe94. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:49:18 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Volume volume-ab32dda2-a53a-4295-9111-7ff217ca00fa (ab32dda2-a53a-4295-9111-7ff217ca00fa): created successfully Sep 05 20:49:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6126a4-7bb9-4703-852a-705c6e153303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Flow 'volume_create_manager' (58b7617b-2627-4927-808f-57ab04486434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3a3857e2-4023-41cc-b55a-304c2b2cbd7e tempest-TaggedAttachmentsTest-969528649 None] Created volume successfully. Sep 05 20:49:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-8996360d-3515-481c-a443-1515955ea25a req-41f5e444-decc-42e4-bf64-d72b7391f4c4 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-8996360d-3515-481c-a443-1515955ea25a req-41f5e444-decc-42e4-bf64-d72b7391f4c4 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-8996360d-3515-481c-a443-1515955ea25a req-41f5e444-decc-42e4-bf64-d72b7391f4c4 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-8996360d-3515-481c-a443-1515955ea25a req-41f5e444-decc-42e4-bf64-d72b7391f4c4 tempest-ServerActionsTestOtherA-839199023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-d2f9516b-560e-46e1-90f7-d325c0691fc7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cda1658d-a427-43ec-8240-b415aa604616', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:49:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-8996360d-3515-481c-a443-1515955ea25a req-41f5e444-decc-42e4-bf64-d72b7391f4c4 tempest-ServerActionsTestOtherA-839199023 None] attachment_update completed successfully. Sep 05 20:49:29 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:49:29 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:49:33 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-52116c02-3e5b-4bf6-aabe-d724c86ddd27 req-e4434405-f1fc-4bde-b55f-8cd7de6b05ab tempest-AttachVolumeNegativeTest-1302627189 None] Terminate volume connection completed successfully. Sep 05 20:49:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-52116c02-3e5b-4bf6-aabe-d724c86ddd27 req-e4434405-f1fc-4bde-b55f-8cd7de6b05ab tempest-AttachVolumeNegativeTest-1302627189 None] Deleting attachment 11357c21-3be8-47d4-8e15-b0427e958794. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:49:43 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:49:43 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Flow 'volume_create_manager' (732fe0fb-9cd3-4864-9d2c-d2a58f6df1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e531d278-d645-4991-ac66-6d603c1ce9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e531d278-d645-4991-ac66-6d603c1ce9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1625976206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906b713f-af49-4f72-82fc-7a480ddb5809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f5bf5baffd4e119600c15c2feff2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:46Z,use_quota=True,user_id='bfa607d57c8746a6bc18ce22649c0ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cf4dfe-9fc4-4638-b5f6-ec285c245017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cf4dfe-9fc4-4638-b5f6-ec285c245017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54468dcb-fbce-431d-a207-ecd0db2a72a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54468dcb-fbce-431d-a207-ecd0db2a72a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906b713f-af49-4f72-82fc-7a480ddb5809', 'volume_name': 'volume-906b713f-af49-4f72-82fc-7a480ddb5809', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff21de41-61a4-4878-bd21-4f64c295862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff21de41-61a4-4878-bd21-4f64c295862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7e1442-3fbc-40ff-9cbe-325e7e1e6968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Volume 906b713f-af49-4f72-82fc-7a480ddb5809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906b713f-af49-4f72-82fc-7a480ddb5809', 'volume_size': 1} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1625976206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906b713f-af49-4f72-82fc-7a480ddb5809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f5bf5baffd4e119600c15c2feff2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:46Z,use_quota=True,user_id='bfa607d57c8746a6bc18ce22649c0ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Creating volume 906b713f-af49-4f72-82fc-7a480ddb5809 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:49:46 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:49:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:46 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 1073741824 Sep 05 20:49:46 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:47 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 1073741824" returned: 0 in 1.117s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:47 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 Sep 05 20:49:47 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:48 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809" returned: 0 in 0.534s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:49:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7e1442-3fbc-40ff-9cbe-325e7e1e6968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906b713f-af49-4f72-82fc-7a480ddb5809', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35f1327-9706-43ce-a591-5f719b33483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Volume volume-906b713f-af49-4f72-82fc-7a480ddb5809 (906b713f-af49-4f72-82fc-7a480ddb5809): created successfully Sep 05 20:49:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35f1327-9706-43ce-a591-5f719b33483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Flow 'volume_create_manager' (732fe0fb-9cd3-4864-9d2c-d2a58f6df1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ebaf8c22-cc00-4922-9c89-9cf514c0663e tempest-ServerRescueNegativeTestJSON-253474558 None] Created volume successfully. Sep 05 20:49:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:49:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:49:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:49:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:55 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:49:55 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-bb4e6278-8edc-412a-b3a2-da7f23d2298d req-d78a7602-32c5-4971-a588-9ceaf0ab74c1 tempest-ServerActionsTestOtherA-839199023 None] Terminate volume connection completed successfully. Sep 05 20:49:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-bb4e6278-8edc-412a-b3a2-da7f23d2298d req-d78a7602-32c5-4971-a588-9ceaf0ab74c1 tempest-ServerActionsTestOtherA-839199023 None] Deleting attachment cda1658d-a427-43ec-8240-b415aa604616. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:49:56 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.892s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Acquiring lock "cinder-906b713f-af49-4f72-82fc-7a480ddb5809-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "cinder-906b713f-af49-4f72-82fc-7a480ddb5809-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Acquiring lock "cinder-quobyte-906b713f-af49-4f72-82fc-7a480ddb5809" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "cinder-quobyte-906b713f-af49-4f72-82fc-7a480ddb5809" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:03 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a1933f-dc1d-4a5b-b5f1-c74a140fe1da]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:03 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 Sep 05 20:50:03 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:04 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809" returned: 0 in 0.711s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:04 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809 Sep 05 20:50:04 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:04 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-906b713f-af49-4f72-82fc-7a480ddb5809" returned: 0 in 0.735s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "cinder-quobyte-906b713f-af49-4f72-82fc-7a480ddb5809" released by "delete_volume" :: held 1.600s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:05 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Created reservations ['b1bac68f-e22b-43be-a6f7-d1159da38602', 'f386e823-7de8-42e7-8232-41e4a14f1a69', '00f30d42-a025-47c7-9023-aa2ad14c40f5', 'af5ac859-0d2d-4416-a1d0-618a14cb501f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:05 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:50:05 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:06 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.601s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:06 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:06 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Deleted volume successfully. Sep 05 20:50:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-91042f91-dd3e-430b-947c-0bcee0180859 tempest-ServerRescueNegativeTestJSON-253474558 None] Lock "cinder-906b713f-af49-4f72-82fc-7a480ddb5809-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:11 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Flow 'volume_create_manager' (07eceefb-ff91-4940-ad41-00d37f1b3831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161da067-8e83-41ca-a8ac-2a09e093c049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161da067-8e83-41ca-a8ac-2a09e093c049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1551353281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba23eec8-64e2-447e-a2df-3c43a0c755f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144abfafdee448d492feeb8b5db690be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:11Z,use_quota=True,user_id='bcd2c6a5f8ec4bfbb915689d1422e5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5895c8-fc72-428b-b111-5a48be4c00aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5895c8-fc72-428b-b111-5a48be4c00aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099b4ad4-0e2e-4bf4-8d74-3ed706cfce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:11 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 20:50:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099b4ad4-0e2e-4bf4-8d74-3ed706cfce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba23eec8-64e2-447e-a2df-3c43a0c755f1', 'volume_name': 'volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c298e19-3911-4a14-8b23-f014ffe61342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c298e19-3911-4a14-8b23-f014ffe61342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dbf45d-91b9-4909-8363-b08bf2899786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:12 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Volume ba23eec8-64e2-447e-a2df-3c43a0c755f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 20:50:12 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Trying to clone ba23eec8-64e2-447e-a2df-3c43a0c755f1 from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 20:50:12 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 20:50:12 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Image download 20.69 MB at 20.69 MB/s Sep 05 20:50:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc706e62-315c-4da9-ae3f-5776e8c07612]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:13 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD Sep 05 20:50:13 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:13 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:13 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df is fetched for user bcd2c6a5f8ec4bfbb915689d1422e5be. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 20:50:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[334338a0-6cc5-4ab3-bb2a-f1cc026c8e5b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:14 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD Sep 05 20:50:14 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:14 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1551353281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba23eec8-64e2-447e-a2df-3c43a0c755f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144abfafdee448d492feeb8b5db690be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:11Z,use_quota=True,user_id='bcd2c6a5f8ec4bfbb915689d1422e5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Creating volume ba23eec8-64e2-447e-a2df-3c43a0c755f1 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:50:14 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:50:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:14 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 1073741824 Sep 05 20:50:14 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:15 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 1073741824" returned: 0 in 0.698s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:15 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 Sep 05 20:50:15 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:15 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1" returned: 0 in 0.463s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:50:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:15 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Attempting download of 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume ba23eec8-64e2-447e-a2df-3c43a0c755f1. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 20:50:15 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5299474-66ee-4fe5-bc23-e00ec3384aa0]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_x9_qszp4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:15 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_x9_qszp4 Sep 05 20:50:15 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:16 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_x9_qszp4" returned: 0 in 0.438s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_x9_qszp4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:16 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_x9_qszp4 Sep 05 20:50:16 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:16 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_x9_qszp4" returned: 1 in 0.420s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_x9_qszp4' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:50:16 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[617920a7-5c8e-40e4-b81e-894d8ef7f721]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:16 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD Sep 05 20:50:16 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:17 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:17 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df was qcow2, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 20:50:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:17 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 Sep 05 20:50:17 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:19 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1" returned: 0 in 2.024s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_wvgble7jdevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:50:19 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Converted 112.00 MB image at 55.30 MB/s Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:19 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 1G Sep 05 20:50:19 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:19 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 1G" returned: 0 in 0.513s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Downloaded image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume ba23eec8-64e2-447e-a2df-3c43a0c755f1 successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df for user bcd2c6a5f8ec4bfbb915689d1422e5be is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Marking volume ba23eec8-64e2-447e-a2df-3c43a0c755f1 as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Copying metadata from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df to ba23eec8-64e2-447e-a2df-3c43a0c755f1. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Creating volume glance metadata for volume ba23eec8-64e2-447e-a2df-3c43a0c755f1 backed by image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dbf45d-91b9-4909-8363-b08bf2899786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97efe642-bf60-40f8-981e-b5a432a8b320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:19 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Volume volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 (ba23eec8-64e2-447e-a2df-3c43a0c755f1): created successfully Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97efe642-bf60-40f8-981e-b5a432a8b320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Flow 'volume_create_manager' (07eceefb-ff91-4940-ad41-00d37f1b3831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bc907afb-e726-44b8-8cdb-d79a2a9a7b37 tempest-ServerActionsTestOtherA-839199023 None] Created volume successfully. Sep 05 20:50:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-800abe00-6d4d-44f1-b93e-e32be00a62b4 req-28bbff12-f543-4851-a9b6-8cff4d806cfb tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-800abe00-6d4d-44f1-b93e-e32be00a62b4 req-28bbff12-f543-4851-a9b6-8cff4d806cfb tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-800abe00-6d4d-44f1-b93e-e32be00a62b4 req-28bbff12-f543-4851-a9b6-8cff4d806cfb tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-800abe00-6d4d-44f1-b93e-e32be00a62b4 req-28bbff12-f543-4851-a9b6-8cff4d806cfb tempest-ServerActionsTestOtherA-839199023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1624d454-fd81-4f37-a37c-2dd74b478873', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:50:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-800abe00-6d4d-44f1-b93e-e32be00a62b4 req-28bbff12-f543-4851-a9b6-8cff4d806cfb tempest-ServerActionsTestOtherA-839199023 None] attachment_update completed successfully. Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Flow 'volume_create_manager' (7123084c-9f06-43ee-bd0f-65ede9ae7757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a3b0b5-cf9b-43a6-b8ae-10b07b0964d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a3b0b5-cf9b-43a6-b8ae-10b07b0964d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1539252898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fcf894-b97a-438a-a207-bba3e66a9ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53ac362b25b4a6c8aafe6fb3325e96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:25Z,use_quota=True,user_id='7018ab36c34c4705b16a434f107fa620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a185dccf-1c14-43d6-9fdf-2b4f0d65fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a185dccf-1c14-43d6-9fdf-2b4f0d65fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd1b33b-6c19-49a2-b9ad-76dfcb5f9ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd1b33b-6c19-49a2-b9ad-76dfcb5f9ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78fcf894-b97a-438a-a207-bba3e66a9ad6', 'volume_name': 'volume-78fcf894-b97a-438a-a207-bba3e66a9ad6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650d75f6-f19b-41bf-b0dc-d9986373728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650d75f6-f19b-41bf-b0dc-d9986373728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea990bf-8bfb-4811-8046-6f253f76ca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:25 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Volume 78fcf894-b97a-438a-a207-bba3e66a9ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78fcf894-b97a-438a-a207-bba3e66a9ad6', 'volume_size': 1} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1539252898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fcf894-b97a-438a-a207-bba3e66a9ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53ac362b25b4a6c8aafe6fb3325e96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:25Z,use_quota=True,user_id='7018ab36c34c4705b16a434f107fa620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Creating volume 78fcf894-b97a-438a-a207-bba3e66a9ad6 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:50:25 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:25 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 1073741824 Sep 05 20:50:25 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:25 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 1073741824" returned: 0 in 0.515s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:26 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 Sep 05 20:50:26 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:26 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6" returned: 0 in 0.323s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:50:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea990bf-8bfb-4811-8046-6f253f76ca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fcf894-b97a-438a-a207-bba3e66a9ad6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96edb8e7-c855-4c4d-ac5e-b8b800598cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:26 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Volume volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 (78fcf894-b97a-438a-a207-bba3e66a9ad6): created successfully Sep 05 20:50:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96edb8e7-c855-4c4d-ac5e-b8b800598cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Flow 'volume_create_manager' (7123084c-9f06-43ee-bd0f-65ede9ae7757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-24e83103-f0d6-483b-9f84-139bbd61b059 req-a63c5e98-ff44-4107-a347-2d08eac7931a tempest-VolumesSnapshotsTestJSON-2071012261 None] Created volume successfully. Sep 05 20:50:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Creating offline snapshot 8c2e3437-20cc-4d1c-bf79-5fdf46061b6c of volume 78fcf894-b97a-438a-a207-bba3e66a9ad6 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:50:28 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[898c5ce0-7ea9-4404-bd92-008342fd55eb]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:28 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 Sep 05 20:50:28 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:28 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6" returned: 0 in 0.762s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:29 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c 1G Sep 05 20:50:29 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:29 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c 1G" returned: 0 in 0.980s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:29 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c Sep 05 20:50:29 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:30 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c" returned: 0 in 0.599s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:30 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c is being set with open permissions: ugo+rw Sep 05 20:50:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:30 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c Sep 05 20:50:30 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:31 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c" returned: 0 in 0.706s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:31 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.info Sep 05 20:50:31 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:31 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.info" returned: 0 in 0.611s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:31 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.info is being set with open permissions: ugo+rw Sep 05 20:50:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:32 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.info Sep 05 20:50:32 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Flow 'volume_create_manager' (3d3e3a5b-5e8c-4f69-b58f-8f885c65408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4deba0-e436-4af1-b018-1815d0961362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4deba0-e436-4af1-b018-1815d0961362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1709046001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca90de4a-7678-4a83-80ee-b242b3423126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef4c372ee8b4d578a07f56a9f9e850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:32Z,use_quota=True,user_id='e7adce3943ea457590f9bcf397209347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930e65d3-98b7-4b6b-8c58-efc68e9ca7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930e65d3-98b7-4b6b-8c58-efc68e9ca7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3567439-a7bf-467c-a9d5-ac7f752892af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3567439-a7bf-467c-a9d5-ac7f752892af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca90de4a-7678-4a83-80ee-b242b3423126', 'volume_name': 'volume-ca90de4a-7678-4a83-80ee-b242b3423126', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d39b6-034c-44a1-b651-03e32169e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d39b6-034c-44a1-b651-03e32169e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f59ee55-94e4-49de-863f-f5e94c0a1337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:32 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Volume ca90de4a-7678-4a83-80ee-b242b3423126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca90de4a-7678-4a83-80ee-b242b3423126', 'volume_size': 1} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:32 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.info" returned: 0 in 0.734s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.595s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1709046001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca90de4a-7678-4a83-80ee-b242b3423126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef4c372ee8b4d578a07f56a9f9e850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:32Z,use_quota=True,user_id='e7adce3943ea457590f9bcf397209347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Creating volume ca90de4a-7678-4a83-80ee-b242b3423126 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:50:32 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:50:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-836d516c-630a-4045-b980-47dea722fa43 req-08ac2375-afd8-48ef-a909-c17e6e17c5ab tempest-VolumesSnapshotsTestJSON-2071012261 None] Create snapshot completed successfully Sep 05 20:50:32 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 1073741824 Sep 05 20:50:32 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:33 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 1073741824" returned: 0 in 0.754s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:33 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 Sep 05 20:50:33 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:33 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126" returned: 0 in 0.338s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f59ee55-94e4-49de-863f-f5e94c0a1337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca90de4a-7678-4a83-80ee-b242b3423126', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdb0530-7272-40ec-b9bb-11a34e493762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:33 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Volume volume-ca90de4a-7678-4a83-80ee-b242b3423126 (ca90de4a-7678-4a83-80ee-b242b3423126): created successfully Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdb0530-7272-40ec-b9bb-11a34e493762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Flow 'volume_create_manager' (3d3e3a5b-5e8c-4f69-b58f-8f885c65408f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:33 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-896b5df5-da06-4c44-af4d-81b0982e9164 tempest-AttachVolumeNegativeTest-1302627189 None] Created volume successfully. Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "cinder-8c2e3437-20cc-4d1c-bf79-5fdf46061b6c-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-8c2e3437-20cc-4d1c-bf79-5fdf46061b6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "cinder-quobyte-78fcf894-b97a-438a-a207-bba3e66a9ad6" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-quobyte-78fcf894-b97a-438a-a207-bba3e66a9ad6" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "cinder-quobyte-8c2e3437-20cc-4d1c-bf79-5fdf46061b6c" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-quobyte-8c2e3437-20cc-4d1c-bf79-5fdf46061b6c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Deleting offline snapshot 8c2e3437-20cc-4d1c-bf79-5fdf46061b6c of volume 78fcf894-b97a-438a-a207-bba3e66a9ad6 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] snapshot_file for this snap is: volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefd0d48-8a19-4c63-8201-227e9c6a5e37]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:35 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c Sep 05 20:50:35 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:36 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c" returned: 0 in 0.767s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fcf894-b97a-438a-a207-bba3e66a9ad6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:50:36 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8522357c-4a4c-451c-b7c4-c99671442916]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:36 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 Sep 05 20:50:36 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-21b76de5-a125-4f66-8918-07f43690b9b3 req-7c88a8a1-103d-4b36-80fc-6fd6e335cb19 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-21b76de5-a125-4f66-8918-07f43690b9b3 req-7c88a8a1-103d-4b36-80fc-6fd6e335cb19 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-21b76de5-a125-4f66-8918-07f43690b9b3 req-7c88a8a1-103d-4b36-80fc-6fd6e335cb19 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-21b76de5-a125-4f66-8918-07f43690b9b3 req-7c88a8a1-103d-4b36-80fc-6fd6e335cb19 tempest-AttachVolumeNegativeTest-1302627189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-ca90de4a-7678-4a83-80ee-b242b3423126', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba09b8fd-43d7-45d5-89a9-2c059a29d80f', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:50:37 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6" returned: 0 in 0.965s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:37 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-21b76de5-a125-4f66-8918-07f43690b9b3 req-7c88a8a1-103d-4b36-80fc-6fd6e335cb19 tempest-AttachVolumeNegativeTest-1302627189 None] attachment_update completed successfully. Sep 05 20:50:37 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c Sep 05 20:50:37 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:38 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c" returned: 0 in 0.637s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:38 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c Sep 05 20:50:38 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cfc57b78-ee36-4bd3-9ac5-a9f993ee5bf6 req-ed075ba5-52eb-47ed-bf27-7245c45c814a tempest-TaggedAttachmentsTest-969528649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cfc57b78-ee36-4bd3-9ac5-a9f993ee5bf6 req-ed075ba5-52eb-47ed-bf27-7245c45c814a tempest-TaggedAttachmentsTest-969528649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cfc57b78-ee36-4bd3-9ac5-a9f993ee5bf6 req-ed075ba5-52eb-47ed-bf27-7245c45c814a tempest-TaggedAttachmentsTest-969528649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cfc57b78-ee36-4bd3-9ac5-a9f993ee5bf6 req-ed075ba5-52eb-47ed-bf27-7245c45c814a tempest-TaggedAttachmentsTest-969528649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-ab32dda2-a53a-4295-9111-7ff217ca00fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d3f4445-49c5-49ea-9567-ff9fe1c29943', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:50:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-cfc57b78-ee36-4bd3-9ac5-a9f993ee5bf6 req-ed075ba5-52eb-47ed-bf27-7245c45c814a tempest-TaggedAttachmentsTest-969528649 None] attachment_update completed successfully. Sep 05 20:50:38 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6.8c2e3437-20cc-4d1c-bf79-5fdf46061b6c" returned: 0 in 0.617s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-quobyte-8c2e3437-20cc-4d1c-bf79-5fdf46061b6c" released by "_delete_snapshot" :: held 3.176s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-quobyte-78fcf894-b97a-438a-a207-bba3e66a9ad6" released by "delete_snapshot" :: held 3.225s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:38 devstack cinder-volume[87802]: WARNING cinder.quota [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:50:39 devstack cinder-volume[87802]: DEBUG cinder.quota [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Created reservations ['de8a1939-4f80-472d-acf7-c35ef3ed9aac', '4f991a86-4c70-4f55-a8f6-c5306c8d0a17', '8c8b712c-26b9-4c05-815e-ab4f630017ee', '9c136005-408a-47cf-8daa-6c6865625392'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Delete snapshot completed successfully. Sep 05 20:50:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-6a38d7ed-daa0-4eb1-8694-dd3f4c9625de req-bd9909f9-019f-46a5-b9b2-05fab9c98a7a tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-8c2e3437-20cc-4d1c-bf79-5fdf46061b6c-delete_snapshot" released by "delete_snapshot" :: held 3.740s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "cinder-78fcf894-b97a-438a-a207-bba3e66a9ad6-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-78fcf894-b97a-438a-a207-bba3e66a9ad6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "cinder-quobyte-78fcf894-b97a-438a-a207-bba3e66a9ad6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-quobyte-78fcf894-b97a-438a-a207-bba3e66a9ad6" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:40 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ccf49d-7916-4a05-8336-f98f36d5bf78]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-872cc7fc-0a0f-408c-a21c-df6cfdff2922 req-c5ea59b7-36ca-45fe-8d7b-ec792e7b2aeb tempest-AttachVolumeNegativeTest-1302627189 None] Terminate volume connection completed successfully. Sep 05 20:50:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-872cc7fc-0a0f-408c-a21c-df6cfdff2922 req-c5ea59b7-36ca-45fe-8d7b-ec792e7b2aeb tempest-AttachVolumeNegativeTest-1302627189 None] Deleting attachment ba09b8fd-43d7-45d5-89a9-2c059a29d80f. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:50:40 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 Sep 05 20:50:40 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:41 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6" returned: 0 in 0.727s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:41 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6 Sep 05 20:50:41 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:41 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78fcf894-b97a-438a-a207-bba3e66a9ad6" returned: 0 in 0.405s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-quobyte-78fcf894-b97a-438a-a207-bba3e66a9ad6" released by "delete_volume" :: held 1.241s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG cinder.quota [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Created reservations ['540a4383-0631-4b70-b110-1034f1790348', '77cbf271-f69e-49a8-bb65-b9d4603e89c4', 'b493dccc-69b8-45ff-bd5c-d46effee317e', 'e2888efd-506a-42e4-b040-1dae0ea125bc'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:42 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:50:42 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-3618cef3-0718-48b0-8930-e2a3ebfdc39a req-ed9ba4d1-2d12-4e20-b9ba-0e13a837322d tempest-TaggedAttachmentsTest-969528649 None] Terminate volume connection completed successfully. Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-3618cef3-0718-48b0-8930-e2a3ebfdc39a req-ed9ba4d1-2d12-4e20-b9ba-0e13a837322d tempest-TaggedAttachmentsTest-969528649 None] Deleting attachment 1d3f4445-49c5-49ea-9567-ff9fe1c29943. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:50:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-eefe09d6-d16d-4c71-ab3c-7b0e882da6e4 req-cc512999-bfa9-4838-956f-e022c4e2c22e tempest-ServerActionsTestOtherA-839199023 None] Terminate volume connection completed successfully. Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-eefe09d6-d16d-4c71-ab3c-7b0e882da6e4 req-cc512999-bfa9-4838-956f-e022c4e2c22e tempest-ServerActionsTestOtherA-839199023 None] Deleting attachment 1624d454-fd81-4f37-a37c-2dd74b478873. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:50:42 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.754s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:42 devstack cinder-volume[87802]: DEBUG cinder.manager [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Deleted volume successfully. Sep 05 20:50:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-db22eb6e-2c1f-47a8-97c3-0b5659cc2582 req-76fc9e84-90f5-4132-89ad-f2afafa6c1c5 tempest-VolumesSnapshotsTestJSON-2071012261 None] Lock "cinder-78fcf894-b97a-438a-a207-bba3e66a9ad6-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:47 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=42,cinder:SELECT=56,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:50:47 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=63,cinder:UPDATE=41,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:50:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-eefe09d6-d16d-4c71-ab3c-7b0e882da6e4 req-ed8fb940-3cce-4800-b17b-229f6f9c2ec1 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-eefe09d6-d16d-4c71-ab3c-7b0e882da6e4 req-ed8fb940-3cce-4800-b17b-229f6f9c2ec1 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-eefe09d6-d16d-4c71-ab3c-7b0e882da6e4 req-ed8fb940-3cce-4800-b17b-229f6f9c2ec1 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-eefe09d6-d16d-4c71-ab3c-7b0e882da6e4 req-ed8fb940-3cce-4800-b17b-229f6f9c2ec1 tempest-ServerActionsTestOtherA-839199023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a2485c1-3508-468f-9270-dea6683733da', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:50:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-eefe09d6-d16d-4c71-ab3c-7b0e882da6e4 req-ed8fb940-3cce-4800-b17b-229f6f9c2ec1 tempest-ServerActionsTestOtherA-839199023 None] attachment_update completed successfully. Sep 05 20:50:50 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Flow 'volume_create_manager' (cc678283-f07c-41e4-82c5-453e9f3efcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fe0c7e-0508-4db9-a6b8-ac4e076d962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fe0c7e-0508-4db9-a6b8-ac4e076d962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-692272960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38e73ff-7629-4d14-9d98-838d7c37b204,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93269c88884a436e8aac2395a61677a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:51Z,use_quota=True,user_id='f1e5d9a58f2f419280300f8d43bbc811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188ca926-9964-46b8-b2b2-a337cdb6bb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188ca926-9964-46b8-b2b2-a337cdb6bb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca5c617-7702-4d7b-8c93-eec7aaf4d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca5c617-7702-4d7b-8c93-eec7aaf4d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38e73ff-7629-4d14-9d98-838d7c37b204', 'volume_name': 'volume-a38e73ff-7629-4d14-9d98-838d7c37b204', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f73275-ea15-4ca1-ab3a-9c9921ab50ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f73275-ea15-4ca1-ab3a-9c9921ab50ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b32e38-c168-4ee3-b295-f5e9d93d3366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:51 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Volume a38e73ff-7629-4d14-9d98-838d7c37b204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38e73ff-7629-4d14-9d98-838d7c37b204', 'volume_size': 1} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-692272960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38e73ff-7629-4d14-9d98-838d7c37b204,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93269c88884a436e8aac2395a61677a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:51Z,use_quota=True,user_id='f1e5d9a58f2f419280300f8d43bbc811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Creating volume a38e73ff-7629-4d14-9d98-838d7c37b204 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:50:51 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:50:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:51 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 1073741824 Sep 05 20:50:51 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:52 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 1073741824" returned: 0 in 0.967s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:52 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 Sep 05 20:50:52 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:52 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204" returned: 0 in 0.359s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b32e38-c168-4ee3-b295-f5e9d93d3366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38e73ff-7629-4d14-9d98-838d7c37b204', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419a6c88-4504-42c4-b187-cadff1b45808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Volume volume-a38e73ff-7629-4d14-9d98-838d7c37b204 (a38e73ff-7629-4d14-9d98-838d7c37b204): created successfully Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419a6c88-4504-42c4-b187-cadff1b45808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Flow 'volume_create_manager' (cc678283-f07c-41e4-82c5-453e9f3efcee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-cbee0d5e-59bb-465a-8020-ca883431b820 req-5b53166c-d2c8-487d-813c-e13eda2542fa tempest-VolumesGetTestJSON-1287167035 None] Created volume successfully. Sep 05 20:50:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Acquiring lock "cinder-a38e73ff-7629-4d14-9d98-838d7c37b204-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Lock "cinder-a38e73ff-7629-4d14-9d98-838d7c37b204-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Acquiring lock "cinder-quobyte-a38e73ff-7629-4d14-9d98-838d7c37b204" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Lock "cinder-quobyte-a38e73ff-7629-4d14-9d98-838d7c37b204" acquired by "delete_volume" :: waited 0.035s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ffae9f-a6a3-4cf3-9b1d-ea7f5a20479e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:54 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 Sep 05 20:50:54 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:55 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204" returned: 0 in 0.773s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:55 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204 Sep 05 20:50:55 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:55 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:50:55 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:55 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a38e73ff-7629-4d14-9d98-838d7c37b204" returned: 0 in 0.627s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Lock "cinder-quobyte-a38e73ff-7629-4d14-9d98-838d7c37b204" released by "delete_volume" :: held 1.501s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:55 devstack cinder-volume[87802]: DEBUG cinder.quota [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Created reservations ['2f02e0ba-cfce-4c6a-9e09-61cc083e76d3', 'd7500d01-7e03-422e-a7ec-98ed633f5d7c', '97bb74a9-ca5c-4bea-8abf-0daef1a7b46b', 'e34168bc-eefd-4d09-b685-1b85e94220a8'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:56 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.615s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:56 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:50:56 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Acquiring lock "cinder-ab32dda2-a53a-4295-9111-7ff217ca00fa-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Lock "cinder-ab32dda2-a53a-4295-9111-7ff217ca00fa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Acquiring lock "cinder-quobyte-ab32dda2-a53a-4295-9111-7ff217ca00fa" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Lock "cinder-quobyte-ab32dda2-a53a-4295-9111-7ff217ca00fa" acquired by "delete_volume" :: waited 0.050s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b60f3e-e713-49af-a09e-9bf6cb5d3422]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:56 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.545s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.manager [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Deleted volume successfully. Sep 05 20:50:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-13722d91-d810-4410-bf9e-0b11ffb60009 req-5f3b57a0-6f75-4633-a1de-a365046387c8 tempest-VolumesGetTestJSON-1287167035 None] Lock "cinder-a38e73ff-7629-4d14-9d98-838d7c37b204-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:56 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa Sep 05 20:50:56 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:57 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa" returned: 0 in 0.714s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:57 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa Sep 05 20:50:57 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:57 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ab32dda2-a53a-4295-9111-7ff217ca00fa" returned: 0 in 0.572s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Lock "cinder-quobyte-ab32dda2-a53a-4295-9111-7ff217ca00fa" released by "delete_volume" :: held 1.378s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Created reservations ['c0a3e06a-4f51-4a4b-a8a2-f7e6617fcdfc', 'f4ad9b2b-bba9-46e3-8588-e64352933546', '61d1ae64-3806-4223-bd8e-79a8ad515385', 'c1ed83d4-92bb-4678-a51a-4b1d3fb77f90'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:58 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:50:58 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:58 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.500s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:58 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Deleted volume successfully. Sep 05 20:50:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af0a8d3b-505e-49e7-bfcd-e145dbbc923f tempest-TaggedAttachmentsTest-969528649 None] Lock "cinder-ab32dda2-a53a-4295-9111-7ff217ca00fa-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Flow 'volume_create_manager' (24d4ce4e-dc51-4a42-8fd2-ee20228a3c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6a6863-fbe0-4309-8636-6d67bb80dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6a6863-fbe0-4309-8636-6d67bb80dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1723913929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9f574f-e963-4f37-82e3-09c0086b1aa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e40947591c944e9936c150cd670041e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:04Z,use_quota=True,user_id='2bf51b4f578c43dd85fe86ec6331e21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1359ef3-3426-4286-b05d-0682ca1e750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1359ef3-3426-4286-b05d-0682ca1e750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18de9f9b-63db-4b08-9e70-d7f4d159c949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18de9f9b-63db-4b08-9e70-d7f4d159c949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f9f574f-e963-4f37-82e3-09c0086b1aa6', 'volume_name': 'volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e0a69f-82a5-47c2-8d72-fc2f8f49a06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e0a69f-82a5-47c2-8d72-fc2f8f49a06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6e9ac3-e2b2-4c43-bdf6-f75c63728321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Volume 4f9f574f-e963-4f37-82e3-09c0086b1aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6', 'volume_size': 1} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1723913929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9f574f-e963-4f37-82e3-09c0086b1aa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e40947591c944e9936c150cd670041e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:04Z,use_quota=True,user_id='2bf51b4f578c43dd85fe86ec6331e21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Creating volume 4f9f574f-e963-4f37-82e3-09c0086b1aa6 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:51:04 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:51:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:04 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 1073741824 Sep 05 20:51:04 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:05 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 1073741824" returned: 0 in 1.227s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:05 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 Sep 05 20:51:05 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:05 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6" returned: 0 in 0.405s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:51:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6e9ac3-e2b2-4c43-bdf6-f75c63728321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f37443-b521-486d-acf1-de7d6a1a06f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:06 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Volume volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 (4f9f574f-e963-4f37-82e3-09c0086b1aa6): created successfully Sep 05 20:51:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f37443-b521-486d-acf1-de7d6a1a06f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Flow 'volume_create_manager' (24d4ce4e-dc51-4a42-8fd2-ee20228a3c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:06 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-10005899-5d43-46cb-b39f-6adc7274581d tempest-VolumesTestJSON-869184611 None] Created volume successfully. Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Flow 'volume_create_manager' (a6961293-340f-4979-aa1b-7819832bf927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31af978e-be0e-4253-9311-0c9c1a64754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31af978e-be0e-4253-9311-0c9c1a64754c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1577678887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f23128-a65c-4527-96f1-90ec8b492159,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e40947591c944e9936c150cd670041e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:08Z,use_quota=True,user_id='2bf51b4f578c43dd85fe86ec6331e21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158ef8fc-1967-41e2-a07d-07ed15ff83f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158ef8fc-1967-41e2-a07d-07ed15ff83f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7825e82b-84ad-4903-9d6c-4d65eb704a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7825e82b-84ad-4903-9d6c-4d65eb704a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f23128-a65c-4527-96f1-90ec8b492159', 'volume_name': 'volume-f1f23128-a65c-4527-96f1-90ec8b492159', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0213233d-8954-43bf-8b4a-473ba373ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0213233d-8954-43bf-8b4a-473ba373ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e81e066-106f-47be-bac8-b17801ceaee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:08 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Volume f1f23128-a65c-4527-96f1-90ec8b492159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f23128-a65c-4527-96f1-90ec8b492159', 'volume_size': 1} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1577678887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f23128-a65c-4527-96f1-90ec8b492159,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e40947591c944e9936c150cd670041e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:08Z,use_quota=True,user_id='2bf51b4f578c43dd85fe86ec6331e21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Creating volume f1f23128-a65c-4527-96f1-90ec8b492159 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:51:08 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:51:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:08 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 1073741824 Sep 05 20:51:08 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:09 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 1073741824" returned: 0 in 1.000s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:09 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 Sep 05 20:51:09 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:10 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159" returned: 0 in 0.356s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:51:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e81e066-106f-47be-bac8-b17801ceaee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f23128-a65c-4527-96f1-90ec8b492159', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633dbfe1-90c4-41df-b678-21eabb93af19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:10 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Volume volume-f1f23128-a65c-4527-96f1-90ec8b492159 (f1f23128-a65c-4527-96f1-90ec8b492159): created successfully Sep 05 20:51:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633dbfe1-90c4-41df-b678-21eabb93af19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Flow 'volume_create_manager' (a6961293-340f-4979-aa1b-7819832bf927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:10 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-67495d4d-519b-4890-8af0-3997fc8b81b8 tempest-VolumesTestJSON-869184611 None] Created volume successfully. Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Flow 'volume_create_manager' (dd013ad9-3db8-41a2-9ce3-ccfc6ddcabe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fec5fd9-4d16-4ac2-8300-452da05f71e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fec5fd9-4d16-4ac2-8300-452da05f71e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-609414694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60d32d6-d4d0-4d4f-95f0-9c81183b3650,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e40947591c944e9936c150cd670041e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:12Z,use_quota=True,user_id='2bf51b4f578c43dd85fe86ec6331e21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01e689f-e8d4-4178-8c42-ab8f9ba17020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01e689f-e8d4-4178-8c42-ab8f9ba17020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba466bcb-1d5e-49bc-8b6c-98d9a3f0b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba466bcb-1d5e-49bc-8b6c-98d9a3f0b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60d32d6-d4d0-4d4f-95f0-9c81183b3650', 'volume_name': 'volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49dd78d-35aa-4dc1-868a-ab13e56ee884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49dd78d-35aa-4dc1-868a-ab13e56ee884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13701bf-d898-414e-bd5b-3bb924ccc54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:12 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Volume f60d32d6-d4d0-4d4f-95f0-9c81183b3650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650', 'volume_size': 1} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-609414694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60d32d6-d4d0-4d4f-95f0-9c81183b3650,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e40947591c944e9936c150cd670041e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:12Z,use_quota=True,user_id='2bf51b4f578c43dd85fe86ec6331e21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Creating volume f60d32d6-d4d0-4d4f-95f0-9c81183b3650 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:51:12 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:12 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 1073741824 Sep 05 20:51:12 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:12 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 1073741824" returned: 0 in 0.464s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:12 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 Sep 05 20:51:12 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:12 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13701bf-d898-414e-bd5b-3bb924ccc54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d845a5-6e2a-4a47-9f09-1de42bbe7c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:12 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Volume volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 (f60d32d6-d4d0-4d4f-95f0-9c81183b3650): created successfully Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d845a5-6e2a-4a47-9f09-1de42bbe7c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Flow 'volume_create_manager' (dd013ad9-3db8-41a2-9ce3-ccfc6ddcabe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:12 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-69ea80c3-233e-412e-82a8-9d1397e85a68 tempest-VolumesTestJSON-869184611 None] Created volume successfully. Sep 05 20:51:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Acquiring lock "cinder-f60d32d6-d4d0-4d4f-95f0-9c81183b3650-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Lock "cinder-f60d32d6-d4d0-4d4f-95f0-9c81183b3650-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Acquiring lock "cinder-quobyte-f60d32d6-d4d0-4d4f-95f0-9c81183b3650" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Lock "cinder-quobyte-f60d32d6-d4d0-4d4f-95f0-9c81183b3650" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:15 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ebf884-2ccb-4319-aa29-4a4b2372a94b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:15 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 Sep 05 20:51:15 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:15 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650" returned: 0 in 0.540s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:15 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650 Sep 05 20:51:15 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:16 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f60d32d6-d4d0-4d4f-95f0-9c81183b3650" returned: 0 in 0.292s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Lock "cinder-quobyte-f60d32d6-d4d0-4d4f-95f0-9c81183b3650" released by "delete_volume" :: held 0.881s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Created reservations ['ebe53ac4-9895-4de8-a4aa-fa41cf3ada4b', '1481c792-baaf-455a-951d-41884d339ab2', 'ca771b43-4d70-4f80-9cbd-5ff46cde32b5', '1c5c28c9-29b1-43bf-9bc9-132bc6be0cf7'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:16 devstack sudo[92311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:16 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Acquiring lock "cinder-f1f23128-a65c-4527-96f1-90ec8b492159-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Lock "cinder-f1f23128-a65c-4527-96f1-90ec8b492159-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Acquiring lock "cinder-quobyte-f1f23128-a65c-4527-96f1-90ec8b492159" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Lock "cinder-quobyte-f1f23128-a65c-4527-96f1-90ec8b492159" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c18c73-040b-4112-b35a-57cdfbf1ec52]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:16 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Deleted volume successfully. Sep 05 20:51:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-92e97560-1e0c-43ac-ac54-81beda6d4ab2 tempest-VolumesTestJSON-869184611 None] Lock "cinder-f60d32d6-d4d0-4d4f-95f0-9c81183b3650-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:16 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 Sep 05 20:51:16 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:17 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159" returned: 0 in 0.515s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:17 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159 Sep 05 20:51:17 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:17 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f1f23128-a65c-4527-96f1-90ec8b492159" returned: 0 in 0.327s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Lock "cinder-quobyte-f1f23128-a65c-4527-96f1-90ec8b492159" released by "delete_volume" :: held 0.897s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Created reservations ['b30bfa1f-dac4-438d-abf6-73fb320d8d66', 'deadfc4a-701c-49fa-bd85-aa773d83ffbf', '533e083a-e45f-4487-b79e-2cb6a03605e7', '9f04ed95-3be7-4fad-8e11-da0fbdf4fc2b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:17 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:17 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Acquiring lock "cinder-4f9f574f-e963-4f37-82e3-09c0086b1aa6-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Lock "cinder-4f9f574f-e963-4f37-82e3-09c0086b1aa6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Acquiring lock "cinder-quobyte-4f9f574f-e963-4f37-82e3-09c0086b1aa6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Lock "cinder-quobyte-4f9f574f-e963-4f37-82e3-09c0086b1aa6" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e213da-dd03-4380-9044-7abd74bfdba2]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:18 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.644s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Deleted volume successfully. Sep 05 20:51:18 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 Sep 05 20:51:18 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf878f9b-9fed-4990-8600-f7ab0c4283f2 tempest-VolumesTestJSON-869184611 None] Lock "cinder-f1f23128-a65c-4527-96f1-90ec8b492159-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:18 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6" returned: 0 in 0.747s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:18 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6 Sep 05 20:51:18 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:19 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4f9f574f-e963-4f37-82e3-09c0086b1aa6" returned: 0 in 0.412s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Lock "cinder-quobyte-4f9f574f-e963-4f37-82e3-09c0086b1aa6" released by "delete_volume" :: held 1.231s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Created reservations ['80039d87-5f53-48d3-8cab-932e7e9f8f18', '3909e6fa-96cb-454a-bb5a-6b1c9c18ab33', '07f9a854-19a4-4a7e-b1bb-db34a61a0443', 'f72c5d12-988a-410a-a2d0-8dafebbdda58'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:19 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:19 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:19 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Deleted volume successfully. Sep 05 20:51:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-192fcd48-2606-4c79-84b6-b0a57e5cb411 tempest-VolumesTestJSON-869184611 None] Lock "cinder-4f9f574f-e963-4f37-82e3-09c0086b1aa6-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:25 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-f712ed74-830c-4156-be5b-dd32c321746d req-b7c3e6f1-1065-412b-b7d0-502317d68e81 tempest-ServerActionsTestOtherA-839199023 None] Terminate volume connection completed successfully. Sep 05 20:51:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-f712ed74-830c-4156-be5b-dd32c321746d req-b7c3e6f1-1065-412b-b7d0-502317d68e81 tempest-ServerActionsTestOtherA-839199023 None] Deleting attachment 1a2485c1-3508-468f-9270-dea6683733da. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:51:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "cinder-ba23eec8-64e2-447e-a2df-3c43a0c755f1-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Lock "cinder-ba23eec8-64e2-447e-a2df-3c43a0c755f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "cinder-quobyte-ba23eec8-64e2-447e-a2df-3c43a0c755f1" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Lock "cinder-quobyte-ba23eec8-64e2-447e-a2df-3c43a0c755f1" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:25 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa89bd-4459-478c-8bbd-e1ff8d2db538]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:25 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 Sep 05 20:51:25 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:26 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1" returned: 0 in 0.464s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:26 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1 Sep 05 20:51:26 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:26 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ba23eec8-64e2-447e-a2df-3c43a0c755f1" returned: 0 in 0.471s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Lock "cinder-quobyte-ba23eec8-64e2-447e-a2df-3c43a0c755f1" released by "delete_volume" :: held 1.006s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:26 devstack cinder-volume[87802]: DEBUG cinder.quota [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Created reservations ['a4fa38d7-f600-42f0-8b01-865a9531a257', '46d9a3db-8743-401b-aba5-1ef72bc2cc45', '8bb4052c-0cbe-41e0-82cd-53e53784890c', '0ef45b0c-88bb-42f3-b882-f35b43728373'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:27 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:27 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0807052b-564a-4d57-bbff-6ba0ab15f392 tempest-GroupSnapshotsTest-888304146 None] Group tempest-GroupSnapshotsTest-Group-1669252860: creating Sep 05 20:51:27 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.462s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG cinder.manager [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Deleted volume successfully. Sep 05 20:51:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0807052b-564a-4d57-bbff-6ba0ab15f392 tempest-GroupSnapshotsTest-888304146 None] Group tempest-GroupSnapshotsTest-Group-1669252860: created successfully Sep 05 20:51:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0807052b-564a-4d57-bbff-6ba0ab15f392 tempest-GroupSnapshotsTest-888304146 None] Create group completed successfully. Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-f712ed74-830c-4156-be5b-dd32c321746d req-3eaa40b9-1578-48d1-93b0-e18ea6ad6eff tempest-ServerActionsTestOtherA-839199023 None] Lock "cinder-ba23eec8-64e2-447e-a2df-3c43a0c755f1-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "cinder-d2f9516b-560e-46e1-90f7-d325c0691fc7-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Lock "cinder-d2f9516b-560e-46e1-90f7-d325c0691fc7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "cinder-quobyte-d2f9516b-560e-46e1-90f7-d325c0691fc7" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Lock "cinder-quobyte-d2f9516b-560e-46e1-90f7-d325c0691fc7" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:28 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb734a96-5dff-4396-b254-c3ba7d2956cf]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:28 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 Sep 05 20:51:28 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:28 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7" returned: 0 in 0.456s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:28 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7 Sep 05 20:51:28 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:28 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d2f9516b-560e-46e1-90f7-d325c0691fc7" returned: 0 in 0.313s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Lock "cinder-quobyte-d2f9516b-560e-46e1-90f7-d325c0691fc7" released by "delete_volume" :: held 0.827s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Created reservations ['2ffbe74d-88e8-4bfe-a3f4-85473877f6ad', '17db23a7-c295-4d80-bb68-8a570b960145', '0424122a-2267-4965-bae6-563262e5fc13', '147104fc-3357-4b04-bf57-cf90b20b6581'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:29 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:29 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Flow 'volume_create_manager' (f0d0f905-d3d0-48c4-8136-d8741ac8f80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040b615f-c9a2-4be4-b07a-55ff2fcdfc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040b615f-c9a2-4be4-b07a-55ff2fcdfc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132307524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d55bcda-2ca4-4400-ae33-70953a1b48f2,host='devstack@QuobyteHD#QuobyteHD',id=e26c55a1-4b3c-460f-8097-d8016b5c6fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7e0a383f3947899a52c3a73b782ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:29Z,use_quota=True,user_id='9466d5aff12040d9a123dee828328f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da21d1e0-12ab-47a0-9469-b5b4d2187859),volume_type_id=da21d1e0-12ab-47a0-9469-b5b4d2187859)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e16daed-8045-483f-a83c-77178d3494c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e16daed-8045-483f-a83c-77178d3494c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bd1bd0-d95b-4709-8191-b3fed844a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bd1bd0-d95b-4709-8191-b3fed844a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26c55a1-4b3c-460f-8097-d8016b5c6fe7', 'volume_name': 'volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b82608-f761-4065-a91a-6017d565f50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b82608-f761-4065-a91a-6017d565f50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394e644c-25be-4946-af46-5e18da444b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:29 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Volume e26c55a1-4b3c-460f-8097-d8016b5c6fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7', 'volume_size': 1} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d55bcda-2ca4-4400-ae33-70953a1b48f2,created_at=2026-09-05T18:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132307524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d55bcda-2ca4-4400-ae33-70953a1b48f2,host='devstack@QuobyteHD#QuobyteHD',id=e26c55a1-4b3c-460f-8097-d8016b5c6fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7e0a383f3947899a52c3a73b782ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:29Z,use_quota=True,user_id='9466d5aff12040d9a123dee828328f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da21d1e0-12ab-47a0-9469-b5b4d2187859),volume_type_id=da21d1e0-12ab-47a0-9469-b5b4d2187859)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Creating volume e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:51:29 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:29 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.467s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:29 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 1073741824 Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:29 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Deleted volume successfully. Sep 05 20:51:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6be8a8f-ccde-4bf8-bd0e-60a91f7f20a9 tempest-ServerActionsTestOtherA-839199023 None] Lock "cinder-d2f9516b-560e-46e1-90f7-d325c0691fc7-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:30 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 1073741824" returned: 0 in 0.678s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:30 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 Sep 05 20:51:30 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:30 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" returned: 0 in 0.333s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394e644c-25be-4946-af46-5e18da444b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7e4f68-4e53-471d-96f9-c1b27cc5a7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:30 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Volume volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 (e26c55a1-4b3c-460f-8097-d8016b5c6fe7): created successfully Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7e4f68-4e53-471d-96f9-c1b27cc5a7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Flow 'volume_create_manager' (f0d0f905-d3d0-48c4-8136-d8741ac8f80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f4b3fae2-21b9-4172-a43f-da15ddfd00e5 tempest-GroupSnapshotsTest-888304146 None] Created volume successfully. Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Flow 'volume_create_manager' (58e2d86d-b9a6-46b2-8e7a-fc760a68505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe37018-7752-414b-9132-e64ce9a89720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe37018-7752-414b-9132-e64ce9a89720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-548779139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32eebfde-373f-4190-a81b-47b69a5db979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef4c372ee8b4d578a07f56a9f9e850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:31Z,use_quota=True,user_id='e7adce3943ea457590f9bcf397209347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12c4c95-48ad-4c86-ab32-8e7f079b1f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12c4c95-48ad-4c86-ab32-8e7f079b1f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e37eddc-f10b-472b-8380-c7df7edccc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e37eddc-f10b-472b-8380-c7df7edccc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32eebfde-373f-4190-a81b-47b69a5db979', 'volume_name': 'volume-32eebfde-373f-4190-a81b-47b69a5db979', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef51dbc7-d596-4fe2-a3f5-63612c466c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef51dbc7-d596-4fe2-a3f5-63612c466c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0805608a-6300-445f-a0e8-13162d6ca471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:31 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Volume 32eebfde-373f-4190-a81b-47b69a5db979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32eebfde-373f-4190-a81b-47b69a5db979', 'volume_size': 1} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-548779139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32eebfde-373f-4190-a81b-47b69a5db979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef4c372ee8b4d578a07f56a9f9e850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:31Z,use_quota=True,user_id='e7adce3943ea457590f9bcf397209347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Creating volume 32eebfde-373f-4190-a81b-47b69a5db979 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:51:31 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:51:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:31 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 1073741824 Sep 05 20:51:31 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:32 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 1073741824" returned: 0 in 0.661s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:32 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 Sep 05 20:51:32 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] GroupSnapshot 574b8339-9ce7-4da5-8276-ca306a1127a8: creating. Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Group snapshot 574b8339-9ce7-4da5-8276-ca306a1127a8: creating. {{(pid=87802) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:32 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979" returned: 0 in 0.445s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.212s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Creating offline snapshot d2c4cb13-be39-43ca-bf44-a6dfd4f40809 of volume e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0805608a-6300-445f-a0e8-13162d6ca471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32eebfde-373f-4190-a81b-47b69a5db979', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c76782-7e95-4157-893a-549382184c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[9361ea3a-bb0c-48f9-ace6-15f8d8fbd9cf]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:32 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Volume volume-32eebfde-373f-4190-a81b-47b69a5db979 (32eebfde-373f-4190-a81b-47b69a5db979): created successfully Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c76782-7e95-4157-893a-549382184c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Flow 'volume_create_manager' (58e2d86d-b9a6-46b2-8e7a-fc760a68505b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-13a44c7d-3ebd-4ace-be75-ab686baf75e2 tempest-AttachVolumeNegativeTest-1302627189 None] Created volume successfully. Sep 05 20:51:32 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 Sep 05 20:51:32 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:33 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" returned: 0 in 0.490s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:33 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 1G Sep 05 20:51:33 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:33 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 1G" returned: 0 in 0.742s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:34 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 Sep 05 20:51:34 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:34 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809" returned: 0 in 0.453s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:34 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:51:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:34 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 Sep 05 20:51:34 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-71c0ba07-f38a-49c1-8996-77f6dada04fa req-bcff94f3-6651-4887-a8aa-6995121897ad tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:34 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809" returned: 0 in 0.375s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:34 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.info Sep 05 20:51:34 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:35 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.info" returned: 0 in 0.274s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:35 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:51:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:35 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.info Sep 05 20:51:35 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:35 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.info" returned: 0 in 0.328s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-71c0ba07-f38a-49c1-8996-77f6dada04fa req-bcff94f3-6651-4887-a8aa-6995121897ad tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.800s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-71c0ba07-f38a-49c1-8996-77f6dada04fa req-bcff94f3-6651-4887-a8aa-6995121897ad tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-71c0ba07-f38a-49c1-8996-77f6dada04fa req-bcff94f3-6651-4887-a8aa-6995121897ad tempest-AttachVolumeNegativeTest-1302627189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-32eebfde-373f-4190-a81b-47b69a5db979', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3bf8850-2ce5-4182-b133-46bf8fd35782', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:51:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-58ab7a3c-d639-447b-97ac-b7875833e7dd tempest-GroupSnapshotsTest-888304146 None] group_snapshot 574b8339-9ce7-4da5-8276-ca306a1127a8: created successfully Sep 05 20:51:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-71c0ba07-f38a-49c1-8996-77f6dada04fa req-bcff94f3-6651-4887-a8aa-6995121897ad tempest-AttachVolumeNegativeTest-1302627189 None] attachment_update completed successfully. Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-d2c4cb13-be39-43ca-bf44-a6dfd4f40809-8f5240e1-c3cc-4594-a2e4-5d225b900912" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-d2c4cb13-be39-43ca-bf44-a6dfd4f40809-8f5240e1-c3cc-4594-a2e4-5d225b900912" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Creating volume 8f5240e1-c3cc-4594-a2e4-5d225b900912 from snapshot d2c4cb13-be39-43ca-bf44-a6dfd4f40809 {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-8f5240e1-c3cc-4594-a2e4-5d225b900912" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-8f5240e1-c3cc-4594-a2e4-5d225b900912" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] snapshot: d2c4cb13-be39-43ca-bf44-a6dfd4f40809, volume: 8f5240e1-c3cc-4594-a2e4-5d225b900912, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da03a5d-ffa6-4a48-ad32-a7fd75a5089d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:37 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 Sep 05 20:51:37 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:37 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809" returned: 0 in 0.662s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[84079fff-7cda-4a9f-bad0-d61a76cf3e76]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:38 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 Sep 05 20:51:38 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:38 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" returned: 0 in 0.535s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 20:51:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 20:51:38 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:51:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:38 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 Sep 05 20:51:38 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-fa41e7c2-b499-4932-b1df-49172ef624d7 req-0424c20f-c13c-43ae-b30d-b2f3dfebda68 tempest-AttachVolumeNegativeTest-1302627189 None] Terminate volume connection completed successfully. Sep 05 20:51:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-fa41e7c2-b499-4932-b1df-49172ef624d7 req-0424c20f-c13c-43ae-b30d-b2f3dfebda68 tempest-AttachVolumeNegativeTest-1302627189 None] Deleting attachment a3bf8850-2ce5-4182-b133-46bf8fd35782. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:51:44 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912" returned: 0 in 6.298s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:44 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:51:44 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Converted 1024.00 MB image at 162.57 MB/s Sep 05 20:51:44 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:51:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:44 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 Sep 05 20:51:44 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:45 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912" returned: 0 in 0.321s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-8f5240e1-c3cc-4594-a2e4-5d225b900912" released by "_copy_volume_from_snapshot" :: held 7.954s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-d2c4cb13-be39-43ca-bf44-a6dfd4f40809-8f5240e1-c3cc-4594-a2e4-5d225b900912" released by "_create_volume_from_snapshot" :: held 8.049s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.081s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d7de7493-3fe2-4a6f-ac1f-4f8bb7f5b9bb tempest-GroupSnapshotsTest-888304146 None] Create group from source-snapshot-574b8339-9ce7-4da5-8276-ca306a1127a8 completed successfully. Sep 05 20:51:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-8f5240e1-c3cc-4594-a2e4-5d225b900912" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-8f5240e1-c3cc-4594-a2e4-5d225b900912" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b16bd1-dda6-4b14-b71b-ed0fd73ac84d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:47 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 Sep 05 20:51:47 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:48 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912" returned: 0 in 0.796s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:48 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912 Sep 05 20:51:48 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:48 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8f5240e1-c3cc-4594-a2e4-5d225b900912" returned: 0 in 0.609s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-8f5240e1-c3cc-4594-a2e4-5d225b900912" released by "delete_volume" :: held 1.543s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:48 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=71,cinder:UPDATE=86,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:51:48 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=79,cinder:UPDATE=81,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:51:48 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['8e64a1b7-8c08-41c4-9a04-c7d6d0e05fcf'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:48 devstack cinder-volume[87802]: WARNING cinder.quota [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1544282652 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1544282652, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:51:48 devstack cinder-volume[87802]: WARNING cinder.quota [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1544282652 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1544282652, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:51:48 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['b2997bf9-ed8d-4717-acb3-bbf17edc526e', 'ad10795c-359e-4d5c-9ad1-5a125daa626e', '2790aeb9-6033-41fd-932d-9d4287c27972', '4e982a52-76fa-44f8-a23e-72d14d85c526'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:49 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:49 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "cinder-32eebfde-373f-4190-a81b-47b69a5db979-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-32eebfde-373f-4190-a81b-47b69a5db979-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "cinder-quobyte-32eebfde-373f-4190-a81b-47b69a5db979" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-quobyte-32eebfde-373f-4190-a81b-47b69a5db979" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec33be0-7495-491f-a64a-62a479dd359a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:49 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.530s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:49 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-84bb9e36-6059-4d57-b2d8-254e6aa60ad6 tempest-GroupSnapshotsTest-888304146 None] Delete group completed successfully. Sep 05 20:51:49 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 Sep 05 20:51:49 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] group_snapshot 574b8339-9ce7-4da5-8276-ca306a1127a8: deleting Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] group_snapshot 574b8339-9ce7-4da5-8276-ca306a1127a8: deleting {{(pid=87802) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 20:51:50 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979" returned: 0 in 0.612s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:50 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979 Sep 05 20:51:50 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-d2c4cb13-be39-43ca-bf44-a6dfd4f40809" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-d2c4cb13-be39-43ca-bf44-a6dfd4f40809" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Deleting offline snapshot d2c4cb13-be39-43ca-bf44-a6dfd4f40809 of volume e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] snapshot_file for this snap is: volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f550d090-0a9b-49ef-a398-46b061632abd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:50 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 Sep 05 20:51:50 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:50 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-32eebfde-373f-4190-a81b-47b69a5db979" returned: 0 in 0.581s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-quobyte-32eebfde-373f-4190-a81b-47b69a5db979" released by "delete_volume" :: held 1.289s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:50 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Created reservations ['82435797-4e2b-481a-b390-22f0c70007f9', 'cfb3f67f-4a5e-4b6d-8957-fe2ffad8ccde', '75a3fc41-f9b8-40ab-8580-fc463e59e3de', '1242d821-97f0-4875-b418-e6c8aacd5efd'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:51 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:51 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:51 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809" returned: 0 in 0.799s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e70059-8ba9-48bd-8dec-bc5cd32cf7db]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:51 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 Sep 05 20:51:51 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:51 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.459s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Deleted volume successfully. Sep 05 20:51:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-146874a5-e320-45fd-b72d-ecd28a7da7dc tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-32eebfde-373f-4190-a81b-47b69a5db979-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "cinder-ca90de4a-7678-4a83-80ee-b242b3423126-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:52 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" returned: 0 in 0.742s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:52 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-ca90de4a-7678-4a83-80ee-b242b3423126-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:52 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "cinder-quobyte-ca90de4a-7678-4a83-80ee-b242b3423126" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-quobyte-ca90de4a-7678-4a83-80ee-b242b3423126" acquired by "delete_volume" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8b405e-271f-4b96-85ca-49bc4b74c5d2]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:52 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 Sep 05 20:51:52 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:52 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809" returned: 0 in 0.852s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:52 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809 Sep 05 20:51:52 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:53 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126" returned: 0 in 0.893s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:53 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126 Sep 05 20:51:53 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:53 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7.d2c4cb13-be39-43ca-bf44-a6dfd4f40809" returned: 0 in 0.416s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-d2c4cb13-be39-43ca-bf44-a6dfd4f40809" released by "_delete_snapshot" :: held 3.051s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" released by "delete_snapshot" :: held 3.132s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:53 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ca90de4a-7678-4a83-80ee-b242b3423126" returned: 0 in 0.467s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-quobyte-ca90de4a-7678-4a83-80ee-b242b3423126" released by "delete_volume" :: held 1.464s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:53 devstack cinder-volume[87802]: WARNING cinder.quota [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1544282652 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1544282652, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['fc3c187f-f881-4e62-af03-375744a66d9f', '253ca5b0-a728-47ec-b68b-008abe0e16da', '97250707-ecf2-4e06-8d8f-1c34fb4648cb', '7db5e7c3-67e5-4837-8b9c-371ea8e544de'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Created reservations ['90b56664-6267-4c19-9f1e-69d10180a73a', 'cbabfd8a-a347-4e20-956f-d1eb8696d502', '827c3086-fb76-4a6e-916a-8d21c76d11f6', 'd6ddd729-6545-4f86-966a-8f45cd93ac36'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8f9e5190-ffcb-4c65-80b1-490b707f76b8 tempest-GroupSnapshotsTest-888304146 None] group_snapshot 574b8339-9ce7-4da5-8276-ca306a1127a8: deleted successfully Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:53 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:53 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:54 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.591s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:54 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:54 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Deleted volume successfully. Sep 05 20:51:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e5c52dd3-ef26-4082-b802-dc004cfceee1 tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-ca90de4a-7678-4a83-80ee-b242b3423126-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "cinder-acf95a7c-7c3b-4075-8600-a9363d2150fd-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-acf95a7c-7c3b-4075-8600-a9363d2150fd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "cinder-quobyte-acf95a7c-7c3b-4075-8600-a9363d2150fd" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-quobyte-acf95a7c-7c3b-4075-8600-a9363d2150fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5970aa2-d703-409a-b99b-cca114552017]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" acquired by "delete_volume" :: waited 0.042s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c3dd20-d295-4638-af12-8e9019a87c5f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:55 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd Sep 05 20:51:55 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:55 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 Sep 05 20:51:55 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:55 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:55 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:56 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd" returned: 0 in 0.940s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:56 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" returned: 0 in 0.677s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:56 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd Sep 05 20:51:56 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:56 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7 Sep 05 20:51:56 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:56 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.565s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:51:56 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-acf95a7c-7c3b-4075-8600-a9363d2150fd" returned: 0 in 0.474s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-quobyte-acf95a7c-7c3b-4075-8600-a9363d2150fd" released by "delete_volume" :: held 1.530s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:56 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" returned: 0 in 0.489s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-e26c55a1-4b3c-460f-8097-d8016b5c6fe7" released by "delete_volume" :: held 1.286s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Created reservations ['661532d8-7593-4f3d-a05c-6d7cb5b6b183', 'd806d835-56cf-4f38-8d93-b97fcfe4e1fb', '52d8f5bc-8312-4e3d-87af-c1c95300c4fd', '336f1afd-e318-4dd3-9149-f4cc5179e57c'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['1682d7ea-8c5c-4217-b14f-d6931c123c3f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:56 devstack cinder-volume[87802]: WARNING cinder.db.api [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1544282652'] Sep 05 20:51:56 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['ee799491-fcf9-484a-bf8c-69a1a9067775', '9ff56db4-e403-456e-a5eb-f4107fa8ec8c', '03d30fcb-cdd0-4d0f-8045-facd16103a4c', 'de06198d-3267-4128-ad88-92fc0b87e02b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:56 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:56 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:57 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:51:57 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:57 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.477s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Deleted volume successfully. Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af4feed2-038c-4f98-975b-f875d154f34e tempest-AttachVolumeNegativeTest-1302627189 None] Lock "cinder-acf95a7c-7c3b-4075-8600-a9363d2150fd-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:57 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.431s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:57 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-cff94014-ab66-43ec-b567-ca67d31dfd18 tempest-GroupSnapshotsTest-888304146 None] Delete group completed successfully. Sep 05 20:51:58 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-62163660-e328-4356-9933-5cbd08d03293 tempest-GroupSnapshotsTest-888304146 None] Group tempest-GroupSnapshotsTest-Group-602539345: creating Sep 05 20:51:58 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-62163660-e328-4356-9933-5cbd08d03293 tempest-GroupSnapshotsTest-888304146 None] Group tempest-GroupSnapshotsTest-Group-602539345: created successfully Sep 05 20:51:58 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-62163660-e328-4356-9933-5cbd08d03293 tempest-GroupSnapshotsTest-888304146 None] Create group completed successfully. Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Flow 'volume_create_manager' (f7aad11a-8c16-4576-97fc-41ebabff2f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123bab2b-64b6-484b-bdc2-c5301fb7f5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123bab2b-64b6-484b-bdc2-c5301fb7f5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1220274619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=389a5846-6fd9-42db-8e5f-b7c7fdb767b9,host='devstack@QuobyteHD#QuobyteHD',id=67485993-b49a-4e74-9c77-ef85f31eba80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7e0a383f3947899a52c3a73b782ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:01Z,use_quota=True,user_id='9466d5aff12040d9a123dee828328f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82199376-f200-41b8-aa9e-2ce839a50344),volume_type_id=82199376-f200-41b8-aa9e-2ce839a50344)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47ecbc6-4acc-4561-8cf4-ff200f0de43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47ecbc6-4acc-4561-8cf4-ff200f0de43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d81cf7-7b48-40a0-a1b2-4aead29511f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d81cf7-7b48-40a0-a1b2-4aead29511f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67485993-b49a-4e74-9c77-ef85f31eba80', 'volume_name': 'volume-67485993-b49a-4e74-9c77-ef85f31eba80', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ced5756-d9be-4e83-b29d-300cf2b62f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ced5756-d9be-4e83-b29d-300cf2b62f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b5d855-7f0d-431d-96ee-9c9c5c2ee0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:00 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Volume 67485993-b49a-4e74-9c77-ef85f31eba80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67485993-b49a-4e74-9c77-ef85f31eba80', 'volume_size': 1} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=389a5846-6fd9-42db-8e5f-b7c7fdb767b9,created_at=2026-09-05T18:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1220274619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=389a5846-6fd9-42db-8e5f-b7c7fdb767b9,host='devstack@QuobyteHD#QuobyteHD',id=67485993-b49a-4e74-9c77-ef85f31eba80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7e0a383f3947899a52c3a73b782ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:01Z,use_quota=True,user_id='9466d5aff12040d9a123dee828328f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82199376-f200-41b8-aa9e-2ce839a50344),volume_type_id=82199376-f200-41b8-aa9e-2ce839a50344)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Creating volume 67485993-b49a-4e74-9c77-ef85f31eba80 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:00 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:00 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 1073741824 Sep 05 20:52:00 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:01 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 1073741824" returned: 0 in 0.672s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:01 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 Sep 05 20:52:01 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:01 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b5d855-7f0d-431d-96ee-9c9c5c2ee0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67485993-b49a-4e74-9c77-ef85f31eba80', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b67395-46ec-4a6a-a498-2bb8b1b222b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:02 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Volume volume-67485993-b49a-4e74-9c77-ef85f31eba80 (67485993-b49a-4e74-9c77-ef85f31eba80): created successfully Sep 05 20:52:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b67395-46ec-4a6a-a498-2bb8b1b222b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Flow 'volume_create_manager' (f7aad11a-8c16-4576-97fc-41ebabff2f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:02 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-81c8aef0-f175-4c9f-8f8f-e1577b0a9bdd tempest-GroupSnapshotsTest-888304146 None] Created volume successfully. Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Flow 'volume_create_manager' (f6308cab-3c6c-4bc8-b3f7-3200e647be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d315232-216f-4b01-8d06-03f016ca7c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d315232-216f-4b01-8d06-03f016ca7c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-810243236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=389a5846-6fd9-42db-8e5f-b7c7fdb767b9,host='devstack@QuobyteHD#QuobyteHD',id=a51f6799-62d9-4b8f-81bf-b40f40180927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7e0a383f3947899a52c3a73b782ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:04Z,use_quota=True,user_id='9466d5aff12040d9a123dee828328f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82199376-f200-41b8-aa9e-2ce839a50344),volume_type_id=82199376-f200-41b8-aa9e-2ce839a50344)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc565b88-72ff-434c-bd2c-ea8947b62519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc565b88-72ff-434c-bd2c-ea8947b62519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b093c839-851a-47bd-9079-358e982d6d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b093c839-851a-47bd-9079-358e982d6d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51f6799-62d9-4b8f-81bf-b40f40180927', 'volume_name': 'volume-a51f6799-62d9-4b8f-81bf-b40f40180927', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b22f23-f436-479f-81d4-9095325ef879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b22f23-f436-479f-81d4-9095325ef879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecfb541-8b39-4495-93ad-e923a1c0123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:04 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Volume a51f6799-62d9-4b8f-81bf-b40f40180927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51f6799-62d9-4b8f-81bf-b40f40180927', 'volume_size': 1} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=389a5846-6fd9-42db-8e5f-b7c7fdb767b9,created_at=2026-09-05T18:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-810243236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=389a5846-6fd9-42db-8e5f-b7c7fdb767b9,host='devstack@QuobyteHD#QuobyteHD',id=a51f6799-62d9-4b8f-81bf-b40f40180927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7e0a383f3947899a52c3a73b782ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:04Z,use_quota=True,user_id='9466d5aff12040d9a123dee828328f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82199376-f200-41b8-aa9e-2ce839a50344),volume_type_id=82199376-f200-41b8-aa9e-2ce839a50344)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Creating volume a51f6799-62d9-4b8f-81bf-b40f40180927 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:04 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:04 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 1073741824 Sep 05 20:52:04 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:04 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 1073741824" returned: 0 in 0.694s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:05 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 Sep 05 20:52:05 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:05 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927" returned: 0 in 0.289s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecfb541-8b39-4495-93ad-e923a1c0123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51f6799-62d9-4b8f-81bf-b40f40180927', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d038c9-cbbb-48f3-b531-d126b88375d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:05 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Volume volume-a51f6799-62d9-4b8f-81bf-b40f40180927 (a51f6799-62d9-4b8f-81bf-b40f40180927): created successfully Sep 05 20:52:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d038c9-cbbb-48f3-b531-d126b88375d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Flow 'volume_create_manager' (f6308cab-3c6c-4bc8-b3f7-3200e647be84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-dd1390cd-c859-4972-a500-ac18ebf37050 tempest-GroupSnapshotsTest-888304146 None] Created volume successfully. Sep 05 20:52:07 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ea19a358-ee7a-4d35-9352-83b3d07cce31 tempest-GroupSnapshotsTest-888304146 None] Update group completed successfully. Sep 05 20:52:08 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-65180304-5167-4d2e-976b-38f6ee366da6 tempest-GroupSnapshotsTest-888304146 None] Update group completed successfully. Sep 05 20:52:09 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0241d969-a178-4297-84f3-6b4fd75bea1c tempest-GroupSnapshotsTest-888304146 None] Update group completed successfully. Sep 05 20:52:11 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b2f4a224-cd0f-43bf-8c2d-9a4c554dae1f tempest-GroupSnapshotsTest-888304146 None] Update group completed successfully. Sep 05 20:52:13 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] GroupSnapshot 2dbf80c4-7727-4509-ad32-c0e86ecbbd4d: creating. Sep 05 20:52:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Group snapshot 2dbf80c4-7727-4509-ad32-c0e86ecbbd4d: creating. {{(pid=87802) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 20:52:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Creating offline snapshot 7df16ac1-6494-4386-80d1-c321641e8104 of volume 67485993-b49a-4e74-9c77-ef85f31eba80 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:52:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d581248-0d42-430d-a477-9a8c6d02aadd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:13 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 Sep 05 20:52:13 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:13 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80" returned: 0 in 0.659s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:13 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 1G Sep 05 20:52:13 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:14 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 1G" returned: 0 in 0.733s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67485993-b49a-4e74-9c77-ef85f31eba80 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:14 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67485993-b49a-4e74-9c77-ef85f31eba80 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 Sep 05 20:52:14 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:15 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67485993-b49a-4e74-9c77-ef85f31eba80 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104" returned: 0 in 0.442s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:15 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:15 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 Sep 05 20:52:15 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Flow 'volume_create_manager' (5846bad1-c0ee-4820-96cf-a52f60b1e57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8444c4-fd0e-4119-88d4-45cc222b1488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8444c4-fd0e-4119-88d4-45cc222b1488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-248967481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b12e1e-81ea-4e49-8391-07d6613d2c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee157033eef4ee6a49450925c1a9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:15Z,use_quota=True,user_id='7ffda631b731494d9d9250c05e972709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7218242-1e4c-4b50-acfd-9719be477e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7218242-1e4c-4b50-acfd-9719be477e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2ed299-1366-4b63-94b2-f4c1534df03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2ed299-1366-4b63-94b2-f4c1534df03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b12e1e-81ea-4e49-8391-07d6613d2c07', 'volume_name': 'volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9c2a28-0aa6-410b-a2d3-dd65b983ce52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9c2a28-0aa6-410b-a2d3-dd65b983ce52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324213cd-edcd-4b6d-a339-928059e9bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:15 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Volume a3b12e1e-81ea-4e49-8391-07d6613d2c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07', 'volume_size': 1} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:15 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104" returned: 0 in 0.388s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:15 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.info Sep 05 20:52:15 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:15 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.info" returned: 0 in 0.331s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:15 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:15 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.info Sep 05 20:52:15 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:16 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.info" returned: 0 in 0.312s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.025s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Creating offline snapshot 9518f42c-3d62-44c1-90d8-a3ccd23070f0 of volume a51f6799-62d9-4b8f-81bf-b40f40180927 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[629f0d3f-0c71-42aa-844b-41793fca6676]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:16 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 Sep 05 20:52:16 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:16 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927" returned: 0 in 0.542s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:16 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 1G Sep 05 20:52:16 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:17 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 1G" returned: 0 in 0.705s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51f6799-62d9-4b8f-81bf-b40f40180927 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:17 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51f6799-62d9-4b8f-81bf-b40f40180927 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 Sep 05 20:52:17 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:17 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51f6799-62d9-4b8f-81bf-b40f40180927 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0" returned: 0 in 0.385s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:17 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:17 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 Sep 05 20:52:17 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:18 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0" returned: 0 in 0.327s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:18 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.info Sep 05 20:52:18 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:18 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.info" returned: 0 in 0.414s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:18 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:18 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.info Sep 05 20:52:18 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:18 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.info" returned: 0 in 0.306s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.807s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.597s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-248967481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b12e1e-81ea-4e49-8391-07d6613d2c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee157033eef4ee6a49450925c1a9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:15Z,use_quota=True,user_id='7ffda631b731494d9d9250c05e972709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Creating volume a3b12e1e-81ea-4e49-8391-07d6613d2c07 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:19 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:19 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 1073741824 Sep 05 20:52:19 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-edace4b5-1384-4dbd-b429-3dfcac148594 tempest-GroupSnapshotsTest-888304146 None] group_snapshot 2dbf80c4-7727-4509-ad32-c0e86ecbbd4d: created successfully Sep 05 20:52:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-4c56f9d6-a378-4210-8d1c-518cc2fa2121 tempest-GroupsTest-1117240337 None] Group tempest-Group1-518649533: creating Sep 05 20:52:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-4c56f9d6-a378-4210-8d1c-518cc2fa2121 tempest-GroupsTest-1117240337 None] Group tempest-Group1-518649533: created successfully Sep 05 20:52:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-4c56f9d6-a378-4210-8d1c-518cc2fa2121 tempest-GroupsTest-1117240337 None] Create group completed successfully. Sep 05 20:52:19 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 1073741824" returned: 0 in 0.607s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:19 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 Sep 05 20:52:19 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] group_snapshot 2dbf80c4-7727-4509-ad32-c0e86ecbbd4d: deleting Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] group_snapshot 2dbf80c4-7727-4509-ad32-c0e86ecbbd4d: deleting {{(pid=87802) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-67485993-b49a-4e74-9c77-ef85f31eba80" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-67485993-b49a-4e74-9c77-ef85f31eba80" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-7df16ac1-6494-4386-80d1-c321641e8104" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-7df16ac1-6494-4386-80d1-c321641e8104" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Deleting offline snapshot 7df16ac1-6494-4386-80d1-c321641e8104 of volume 67485993-b49a-4e74-9c77-ef85f31eba80 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] snapshot_file for this snap is: volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[00559a45-9ffd-459a-aec0-2f19dfa88867]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:20 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07" returned: 0 in 0.433s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324213cd-edcd-4b6d-a339-928059e9bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d63e581-0eb2-4d32-95b7-ccc326b89573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:20 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 Sep 05 20:52:20 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:20 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Volume volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 (a3b12e1e-81ea-4e49-8391-07d6613d2c07): created successfully Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d63e581-0eb2-4d32-95b7-ccc326b89573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Flow 'volume_create_manager' (5846bad1-c0ee-4820-96cf-a52f60b1e57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8743ba4b-1b32-4e8d-b0cf-c60fb560a0ce tempest-ServersNegativeTestJSON-1663735209 None] Created volume successfully. Sep 05 20:52:20 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104" returned: 0 in 0.525s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67485993-b49a-4e74-9c77-ef85f31eba80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[52689eba-d47e-4cd9-85d4-b9e2a03dc28b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ab0ad643-f242-476c-b319-b8648920e8f3 tempest-GroupsTest-1117240337 None] Group tempest-Group2-1666167873: creating Sep 05 20:52:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ab0ad643-f242-476c-b319-b8648920e8f3 tempest-GroupsTest-1117240337 None] Group tempest-Group2-1666167873: created successfully Sep 05 20:52:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ab0ad643-f242-476c-b319-b8648920e8f3 tempest-GroupsTest-1117240337 None] Create group completed successfully. Sep 05 20:52:20 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 Sep 05 20:52:20 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:21 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80" returned: 0 in 0.684s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:21 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 Sep 05 20:52:21 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:22 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104" returned: 0 in 0.816s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:22 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104 Sep 05 20:52:22 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:22 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80.7df16ac1-6494-4386-80d1-c321641e8104" returned: 0 in 0.635s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-7df16ac1-6494-4386-80d1-c321641e8104" released by "_delete_snapshot" :: held 2.878s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-67485993-b49a-4e74-9c77-ef85f31eba80" released by "delete_snapshot" :: held 2.924s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-a51f6799-62d9-4b8f-81bf-b40f40180927" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-a51f6799-62d9-4b8f-81bf-b40f40180927" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-9518f42c-3d62-44c1-90d8-a3ccd23070f0" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-9518f42c-3d62-44c1-90d8-a3ccd23070f0" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Deleting offline snapshot 9518f42c-3d62-44c1-90d8-a3ccd23070f0 of volume a51f6799-62d9-4b8f-81bf-b40f40180927 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] snapshot_file for this snap is: volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa253ca-1b14-491e-beaf-8364b615f562]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Flow 'volume_create_manager' (a5dc119d-d386-4aff-aabc-160cb764be2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d390ef8-e013-48b2-8c13-06f87bea24ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:23 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 Sep 05 20:52:23 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d390ef8-e013-48b2-8c13-06f87bea24ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-280364805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd8c63f9-ee1c-47af-84f8-ffabda7ecfdc,host='devstack@QuobyteHD#QuobyteHD',id=fb0791b3-ac81-4222-bc85-61084ffde578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6123da987a16455988964f9edcf60348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:23Z,use_quota=True,user_id='8409cf0e071646aa834d57ade2c5cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(832d5fc5-c5e4-4048-baf6-6455c4e0378c),volume_type_id=832d5fc5-c5e4-4048-baf6-6455c4e0378c)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761c6566-1c46-43d5-9999-1620c1b3beb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761c6566-1c46-43d5-9999-1620c1b3beb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf7bbf2-0c60-4897-b20c-07a10adf8e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf7bbf2-0c60-4897-b20c-07a10adf8e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb0791b3-ac81-4222-bc85-61084ffde578', 'volume_name': 'volume-fb0791b3-ac81-4222-bc85-61084ffde578', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3261acff-4e24-4244-b02b-21f38c5e345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3261acff-4e24-4244-b02b-21f38c5e345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f658999-f493-47b0-8f81-04a9a02e5226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Volume fb0791b3-ac81-4222-bc85-61084ffde578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb0791b3-ac81-4222-bc85-61084ffde578', 'volume_size': 1} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd8c63f9-ee1c-47af-84f8-ffabda7ecfdc,created_at=2026-09-05T18:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-280364805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd8c63f9-ee1c-47af-84f8-ffabda7ecfdc,host='devstack@QuobyteHD#QuobyteHD',id=fb0791b3-ac81-4222-bc85-61084ffde578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6123da987a16455988964f9edcf60348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:23Z,use_quota=True,user_id='8409cf0e071646aa834d57ade2c5cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(832d5fc5-c5e4-4048-baf6-6455c4e0378c),volume_type_id=832d5fc5-c5e4-4048-baf6-6455c4e0378c)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Creating volume fb0791b3-ac81-4222-bc85-61084ffde578 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:23 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:23 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 1073741824 Sep 05 20:52:23 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:24 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0" returned: 0 in 0.949s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a51f6799-62d9-4b8f-81bf-b40f40180927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa1b51d-6e84-4f9b-9b1a-093400ba1de4]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:24 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 Sep 05 20:52:24 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Flow 'volume_create_manager' (80e56fac-3e0c-4ad9-857b-01e4202985af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce2377a-3ea5-491b-bd73-fda47e0ec0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce2377a-3ea5-491b-bd73-fda47e0ec0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-319739371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a937bfe1-ed1d-487c-a894-575e012582f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee157033eef4ee6a49450925c1a9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:24Z,use_quota=True,user_id='7ffda631b731494d9d9250c05e972709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26980e6-214c-453b-88e3-ab48861e2e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26980e6-214c-453b-88e3-ab48861e2e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447b120b-d89c-4904-ab21-041dffdc9ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447b120b-d89c-4904-ab21-041dffdc9ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a937bfe1-ed1d-487c-a894-575e012582f9', 'volume_name': 'volume-a937bfe1-ed1d-487c-a894-575e012582f9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c51bf08-b33d-4784-9360-c42905776035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c51bf08-b33d-4784-9360-c42905776035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a212e2-eea7-4ce0-ac37-eed3b2d24f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Volume a937bfe1-ed1d-487c-a894-575e012582f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a937bfe1-ed1d-487c-a894-575e012582f9', 'volume_size': 1} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:24 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 1073741824" returned: 0 in 1.276s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:24 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 Sep 05 20:52:24 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:25 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927" returned: 0 in 0.921s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:25 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 Sep 05 20:52:25 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:25 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-319739371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a937bfe1-ed1d-487c-a894-575e012582f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee157033eef4ee6a49450925c1a9fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:24Z,use_quota=True,user_id='7ffda631b731494d9d9250c05e972709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Creating volume a937bfe1-ed1d-487c-a894-575e012582f9 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:25 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f658999-f493-47b0-8f81-04a9a02e5226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0791b3-ac81-4222-bc85-61084ffde578', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:25 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 1073741824 Sep 05 20:52:25 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4850c63-2422-411b-b3cd-be52ed12a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:25 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Volume volume-fb0791b3-ac81-4222-bc85-61084ffde578 (fb0791b3-ac81-4222-bc85-61084ffde578): created successfully Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4850c63-2422-411b-b3cd-be52ed12a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Flow 'volume_create_manager' (a5dc119d-d386-4aff-aabc-160cb764be2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:25 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d65582a2-59f4-4846-bdeb-f08095bd167e tempest-GroupsTest-1117240337 None] Created volume successfully. Sep 05 20:52:25 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0" returned: 0 in 0.555s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:25 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0 Sep 05 20:52:25 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:26 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927.9518f42c-3d62-44c1-90d8-a3ccd23070f0" returned: 0 in 0.341s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-9518f42c-3d62-44c1-90d8-a3ccd23070f0" released by "_delete_snapshot" :: held 3.081s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-a51f6799-62d9-4b8f-81bf-b40f40180927" released by "delete_snapshot" :: held 3.142s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:26 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 1073741824" returned: 0 in 0.785s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:26 devstack cinder-volume[87802]: WARNING cinder.quota [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-353735608 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-353735608, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:26 devstack cinder-volume[87802]: WARNING cinder.quota [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-353735608 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-353735608, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:26 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 Sep 05 20:52:26 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['ce3426bc-b3e9-47fc-b974-40c550deaa29', '238e2023-e228-4220-a8a8-bb60c0f5cef1', 'aa742d25-4d9b-4d2c-b84c-3c0636b1df11', 'fa6ffb11-a0e0-41ea-8392-0117b03800c9'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['2f4f4f61-8d77-475e-8a9e-f9226e43411e', '19be5425-0c16-47df-b75e-0e47ae796832', 'd6e27cd8-207b-4755-8d9a-57cfe5d22b92', '4041c6ea-dfa5-41b2-880c-b45912e01b45'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:26 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c73ff93d-bf3b-4a02-8d64-d40368c403d1 tempest-GroupSnapshotsTest-888304146 None] group_snapshot 2dbf80c4-7727-4509-ad32-c0e86ecbbd4d: deleted successfully Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9" returned: 0 in 0.405s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a212e2-eea7-4ce0-ac37-eed3b2d24f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a937bfe1-ed1d-487c-a894-575e012582f9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e6f53c-79e6-4ae8-8f9a-3b924555c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:26 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Volume volume-a937bfe1-ed1d-487c-a894-575e012582f9 (a937bfe1-ed1d-487c-a894-575e012582f9): created successfully Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e6f53c-79e6-4ae8-8f9a-3b924555c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Flow 'volume_create_manager' (80e56fac-3e0c-4ad9-857b-01e4202985af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-486a64ab-51f2-428c-9622-345487bbadf0 tempest-ServersNegativeTestJSON-1663735209 None] Created volume successfully. Sep 05 20:52:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Acquiring lock "cinder-quobyte-fb0791b3-ac81-4222-bc85-61084ffde578" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Lock "cinder-quobyte-fb0791b3-ac81-4222-bc85-61084ffde578" acquired by "delete_volume" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a830a5-668c-44a7-9c2d-5fd3348fd549]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-67485993-b49a-4e74-9c77-ef85f31eba80" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-67485993-b49a-4e74-9c77-ef85f31eba80" acquired by "delete_volume" :: waited 0.040s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d900af87-e14b-429c-986f-79ef42039ae9]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:27 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 Sep 05 20:52:27 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:27 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 Sep 05 20:52:27 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:28 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578" returned: 0 in 0.761s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:28 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80" returned: 0 in 0.551s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:28 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578 Sep 05 20:52:28 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:28 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80 Sep 05 20:52:28 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "cinder-a937bfe1-ed1d-487c-a894-575e012582f9-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Lock "cinder-a937bfe1-ed1d-487c-a894-575e012582f9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "cinder-quobyte-a937bfe1-ed1d-487c-a894-575e012582f9" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Lock "cinder-quobyte-a937bfe1-ed1d-487c-a894-575e012582f9" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adeea54-02bd-439c-b72a-8b23664fae66]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:28 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fb0791b3-ac81-4222-bc85-61084ffde578" returned: 0 in 0.485s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Lock "cinder-quobyte-fb0791b3-ac81-4222-bc85-61084ffde578" released by "delete_volume" :: held 1.348s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:28 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-67485993-b49a-4e74-9c77-ef85f31eba80" returned: 0 in 0.535s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:28 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 Sep 05 20:52:28 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-67485993-b49a-4e74-9c77-ef85f31eba80" released by "delete_volume" :: held 1.233s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-a51f6799-62d9-4b8f-81bf-b40f40180927" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-a51f6799-62d9-4b8f-81bf-b40f40180927" acquired by "delete_volume" :: waited 0.058s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e70f860-0354-4936-a7bb-384e232eb19e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Created reservations ['fdb81faa-de0a-4aad-b010-a603b5564556'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:28 devstack cinder-volume[87802]: WARNING cinder.quota [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1112473836 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1112473836, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:28 devstack cinder-volume[87802]: WARNING cinder.quota [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1112473836 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1112473836, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:28 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Created reservations ['17972c46-fcc2-4ef7-b67c-8c7441d1397e', 'd8738bf0-18cf-49f6-8d67-1f0836a8d014', '294cc0bd-1bfa-4356-bd53-f75fdbd44250', 'acf6ab27-c24f-4e6f-8443-4fbd604b715b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:29 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 Sep 05 20:52:29 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:29 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9" returned: 0 in 0.659s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:29 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9 Sep 05 20:52:29 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:29 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:52:29 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:29 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927" returned: 0 in 0.608s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:29 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927 Sep 05 20:52:29 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:29 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.368s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-35bf17c0-5cdc-415a-b10c-f092462185d4 tempest-GroupsTest-1117240337 None] Delete group completed successfully. Sep 05 20:52:29 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a937bfe1-ed1d-487c-a894-575e012582f9" returned: 0 in 0.469s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Lock "cinder-quobyte-a937bfe1-ed1d-487c-a894-575e012582f9" released by "delete_volume" :: held 1.211s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Created reservations ['03b2fbae-5540-4b34-b9ca-5e4a4bf50491', 'e4cf19ab-f767-43f4-890a-00c441fb4134', '84883502-47af-4171-8053-04428a8b6d5c', '874b3493-90d4-49f6-b58f-d82818a358e9'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:29 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a51f6799-62d9-4b8f-81bf-b40f40180927" returned: 0 in 0.321s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-a51f6799-62d9-4b8f-81bf-b40f40180927" released by "delete_volume" :: held 1.073s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:29 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:52:29 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:29 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['bc1bf44f-a2cb-4ab0-9e56-3836592c57d8'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:30 devstack cinder-volume[87802]: WARNING cinder.quota [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-353735608 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-353735608, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['1387e20b-9466-402e-986f-91c5a57e5213', 'f19b1566-900a-42a8-bcec-df386b53e9f2', '4f7b3e7a-641a-4be7-a2c5-c0251a954ae5', '820311ad-0a92-4c9a-8c8c-3326d0f593f8'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Created reservations ['6939e479-f554-4199-bee0-619fed6055b2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:30 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.319s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Deleted volume successfully. Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-76e913e2-0203-49de-970d-b2423037c4e7 tempest-ServersNegativeTestJSON-1663735209 None] Lock "cinder-a937bfe1-ed1d-487c-a894-575e012582f9-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:30 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:52:30 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['a4d9dc36-9e1b-4d77-ad6c-195f9d753023', '9997e72a-4d9e-41d4-a73e-b257bbf5f2b4', '69e7527a-2ab4-4c1e-ba6b-a2d745ec7f8c', '200809c6-4e34-40df-8684-67eb1cd42922'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:30 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:52:30 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:30 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ca64e601-ca0c-4880-8f9a-9d64e7742895 tempest-GroupsTest-1117240337 None] Delete group completed successfully. Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "cinder-a3b12e1e-81ea-4e49-8391-07d6613d2c07-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Lock "cinder-a3b12e1e-81ea-4e49-8391-07d6613d2c07-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "cinder-quobyte-a3b12e1e-81ea-4e49-8391-07d6613d2c07" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Lock "cinder-quobyte-a3b12e1e-81ea-4e49-8391-07d6613d2c07" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:30 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.338s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a08c10d1-3057-4a63-a377-032bfc564330 tempest-GroupSnapshotsTest-888304146 None] Delete group completed successfully. Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f4d666-23b6-466d-b97b-2abe42eff34b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:31 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 Sep 05 20:52:31 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:31 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07" returned: 0 in 0.405s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:31 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07 Sep 05 20:52:31 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:31 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3b12e1e-81ea-4e49-8391-07d6613d2c07" returned: 0 in 0.531s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Lock "cinder-quobyte-a3b12e1e-81ea-4e49-8391-07d6613d2c07" released by "delete_volume" :: held 1.006s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:31 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Created reservations ['ac99c2c1-5ad6-477d-93ba-df0f8d6b3e8c', '17914e7b-2492-4997-8ed9-daa3d5753f3b', 'f8fe6358-5f7e-44e4-b6db-4148727afc71', 'be9c651d-3e27-40e4-a27c-5e61b9b1f572'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3822262f-080d-49eb-9211-9b7f03182224 tempest-GroupsTest-1117240337 None] Group tempest-GroupsTest-Group-1280365950: creating Sep 05 20:52:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3822262f-080d-49eb-9211-9b7f03182224 tempest-GroupsTest-1117240337 None] Group tempest-GroupsTest-Group-1280365950: created successfully Sep 05 20:52:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3822262f-080d-49eb-9211-9b7f03182224 tempest-GroupsTest-1117240337 None] Create group completed successfully. Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:32 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:52:32 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fbd1fcd8-ab32-4770-a8c8-5803ea791f44 tempest-GroupSnapshotsTest-888304146 None] Group tempest-GroupSnapshotsTest-Group-1482585568: creating Sep 05 20:52:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fbd1fcd8-ab32-4770-a8c8-5803ea791f44 tempest-GroupSnapshotsTest-888304146 None] Group tempest-GroupSnapshotsTest-Group-1482585568: created successfully Sep 05 20:52:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fbd1fcd8-ab32-4770-a8c8-5803ea791f44 tempest-GroupSnapshotsTest-888304146 None] Create group completed successfully. Sep 05 20:52:32 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Deleted volume successfully. Sep 05 20:52:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a8f2ac0-b24d-456a-8206-3ffbb5a19cec tempest-ServersNegativeTestJSON-1663735209 None] Lock "cinder-a3b12e1e-81ea-4e49-8391-07d6613d2c07-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Flow 'volume_create_manager' (26772cf9-3ea6-4567-9d2e-cfe83c4cf96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7b8fba-171f-4eb5-b57f-90b8aae071d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7b8fba-171f-4eb5-b57f-90b8aae071d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268140483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53d23f3f-0cc6-45e6-8ddc-278b76c10312,host='devstack@QuobyteHD#QuobyteHD',id=f7a57cd5-6e39-4b6e-92ca-88d6990ba131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6123da987a16455988964f9edcf60348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:34Z,use_quota=True,user_id='8409cf0e071646aa834d57ade2c5cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77772c05-348d-4c47-ac74-b4d0ec94e2ed),volume_type_id=77772c05-348d-4c47-ac74-b4d0ec94e2ed)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b891db2-686a-4b3f-944d-7ced904bc93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b891db2-686a-4b3f-944d-7ced904bc93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5619ae0-11a5-41a4-9bfd-1714f294a1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5619ae0-11a5-41a4-9bfd-1714f294a1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a57cd5-6e39-4b6e-92ca-88d6990ba131', 'volume_name': 'volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a92670-ef1a-4a54-8c9c-6e992d89683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a92670-ef1a-4a54-8c9c-6e992d89683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6750e5-44f1-45c8-9e64-d49951a5bb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Volume f7a57cd5-6e39-4b6e-92ca-88d6990ba131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131', 'volume_size': 1} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53d23f3f-0cc6-45e6-8ddc-278b76c10312,created_at=2026-09-05T18:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268140483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53d23f3f-0cc6-45e6-8ddc-278b76c10312,host='devstack@QuobyteHD#QuobyteHD',id=f7a57cd5-6e39-4b6e-92ca-88d6990ba131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6123da987a16455988964f9edcf60348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:34Z,use_quota=True,user_id='8409cf0e071646aa834d57ade2c5cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77772c05-348d-4c47-ac74-b4d0ec94e2ed),volume_type_id=77772c05-348d-4c47-ac74-b4d0ec94e2ed)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Creating volume f7a57cd5-6e39-4b6e-92ca-88d6990ba131 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:34 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:34 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 1073741824 Sep 05 20:52:34 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Flow 'volume_create_manager' (b465491d-1b53-44d6-9119-461427db7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e4a442-3d28-44bf-9b04-4f83b88c9ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e4a442-3d28-44bf-9b04-4f83b88c9ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-812152896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c83c27fe-8a21-49ac-aa23-9459f533f1a9,host='devstack@QuobyteHD#QuobyteHD',id=d9016f02-1bcc-4d29-bbe4-0efa12acfcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7e0a383f3947899a52c3a73b782ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:35Z,use_quota=True,user_id='9466d5aff12040d9a123dee828328f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d950cdd7-a9a7-4bec-96ed-ff600b0b8089),volume_type_id=d950cdd7-a9a7-4bec-96ed-ff600b0b8089)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828a7f8c-4b60-4fe2-bc57-abd6c0f910b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828a7f8c-4b60-4fe2-bc57-abd6c0f910b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bbabfe-cdd4-4c1d-bd38-93012383f576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bbabfe-cdd4-4c1d-bd38-93012383f576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9016f02-1bcc-4d29-bbe4-0efa12acfcd9', 'volume_name': 'volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ccf5bb-a700-46f9-a9f3-45d33205d480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ccf5bb-a700-46f9-a9f3-45d33205d480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50c94e1-3c2a-4621-8dfb-f68d71a24afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Volume d9016f02-1bcc-4d29-bbe4-0efa12acfcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9', 'volume_size': 1} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:35 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 1073741824" returned: 0 in 0.977s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:35 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 Sep 05 20:52:35 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:35 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131" returned: 0 in 0.513s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c83c27fe-8a21-49ac-aa23-9459f533f1a9,created_at=2026-09-05T18:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-812152896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c83c27fe-8a21-49ac-aa23-9459f533f1a9,host='devstack@QuobyteHD#QuobyteHD',id=d9016f02-1bcc-4d29-bbe4-0efa12acfcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7e0a383f3947899a52c3a73b782ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:35Z,use_quota=True,user_id='9466d5aff12040d9a123dee828328f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d950cdd7-a9a7-4bec-96ed-ff600b0b8089),volume_type_id=d950cdd7-a9a7-4bec-96ed-ff600b0b8089)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Creating volume d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:35 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6750e5-44f1-45c8-9e64-d49951a5bb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf1ee5f-c7b5-42a6-8403-56e59b929ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:36 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 1073741824 Sep 05 20:52:36 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:36 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Volume volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 (f7a57cd5-6e39-4b6e-92ca-88d6990ba131): created successfully Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf1ee5f-c7b5-42a6-8403-56e59b929ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Flow 'volume_create_manager' (26772cf9-3ea6-4567-9d2e-cfe83c4cf96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:36 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b8ad1032-e08a-437e-a5d1-ffd48d432961 tempest-GroupsTest-1117240337 None] Created volume successfully. Sep 05 20:52:36 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 1073741824" returned: 0 in 0.596s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:36 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 Sep 05 20:52:36 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:36 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" returned: 0 in 0.286s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50c94e1-3c2a-4621-8dfb-f68d71a24afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca8872d-c1b2-4f9f-bc3f-fc9fd388800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:36 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Volume volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 (d9016f02-1bcc-4d29-bbe4-0efa12acfcd9): created successfully Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca8872d-c1b2-4f9f-bc3f-fc9fd388800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Flow 'volume_create_manager' (b465491d-1b53-44d6-9119-461427db7276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:36 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ba87c582-11d1-42fe-8259-486170ed3507 tempest-GroupSnapshotsTest-888304146 None] Created volume successfully. Sep 05 20:52:37 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] GroupSnapshot 2f4f5bac-093a-4a97-851a-50b167b891d0: creating. Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Group snapshot 2f4f5bac-093a-4a97-851a-50b167b891d0: creating. {{(pid=87802) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Creating offline snapshot 89aac694-168e-4b03-8d3a-91c4fb51121e of volume d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[821e0543-2ed2-417a-a15f-df9d1a05cadd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:37 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 Sep 05 20:52:37 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Flow 'volume_create_manager' (907d9968-7218-473e-9c91-042bf200bb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a138b95-2a5a-4052-b9f0-9a2e84d76682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a138b95-2a5a-4052-b9f0-9a2e84d76682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1790063911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53d23f3f-0cc6-45e6-8ddc-278b76c10312,host='devstack@QuobyteHD#QuobyteHD',id=4b5d7486-125e-4183-8f53-1001c4e75306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6123da987a16455988964f9edcf60348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:38Z,use_quota=True,user_id='8409cf0e071646aa834d57ade2c5cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77772c05-348d-4c47-ac74-b4d0ec94e2ed),volume_type_id=77772c05-348d-4c47-ac74-b4d0ec94e2ed)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f56b4c-9c27-42a2-96d2-081b5317d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f56b4c-9c27-42a2-96d2-081b5317d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5f15a8-dede-4f76-a9eb-1f925d1090ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5f15a8-dede-4f76-a9eb-1f925d1090ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5d7486-125e-4183-8f53-1001c4e75306', 'volume_name': 'volume-4b5d7486-125e-4183-8f53-1001c4e75306', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c543054a-e222-47f6-9bcb-abd8a9bd23f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c543054a-e222-47f6-9bcb-abd8a9bd23f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c223407-def1-4234-af07-af85626e833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:37 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Volume 4b5d7486-125e-4183-8f53-1001c4e75306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5d7486-125e-4183-8f53-1001c4e75306', 'volume_size': 1} Sep 05 20:52:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:38 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" returned: 0 in 0.523s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:38 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e 1G Sep 05 20:52:38 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:38 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e 1G" returned: 0 in 0.471s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:38 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e Sep 05 20:52:38 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:38 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e" returned: 0 in 0.308s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:38 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:38 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e Sep 05 20:52:38 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:39 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e" returned: 0 in 0.300s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:39 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.info Sep 05 20:52:39 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:39 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.info" returned: 0 in 0.291s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:39 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:39 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.info Sep 05 20:52:39 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:39 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.info" returned: 0 in 0.344s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53d23f3f-0cc6-45e6-8ddc-278b76c10312,created_at=2026-09-05T18:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1790063911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53d23f3f-0cc6-45e6-8ddc-278b76c10312,host='devstack@QuobyteHD#QuobyteHD',id=4b5d7486-125e-4183-8f53-1001c4e75306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6123da987a16455988964f9edcf60348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:38Z,use_quota=True,user_id='8409cf0e071646aa834d57ade2c5cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77772c05-348d-4c47-ac74-b4d0ec94e2ed),volume_type_id=77772c05-348d-4c47-ac74-b4d0ec94e2ed)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Creating volume 4b5d7486-125e-4183-8f53-1001c4e75306 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:39 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:39 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 1073741824 Sep 05 20:52:39 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-65fbbf34-d98c-4717-8be0-ae22d5f9870c tempest-GroupSnapshotsTest-888304146 None] group_snapshot 2f4f5bac-093a-4a97-851a-50b167b891d0: created successfully Sep 05 20:52:40 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 1073741824" returned: 0 in 0.476s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:40 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 Sep 05 20:52:40 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:40 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306" returned: 0 in 0.274s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c223407-def1-4234-af07-af85626e833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5d7486-125e-4183-8f53-1001c4e75306', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8b30e0-c877-4544-84bb-8ad1a13451fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:40 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Volume volume-4b5d7486-125e-4183-8f53-1001c4e75306 (4b5d7486-125e-4183-8f53-1001c4e75306): created successfully Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8b30e0-c877-4544-84bb-8ad1a13451fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Flow 'volume_create_manager' (907d9968-7218-473e-9c91-042bf200bb2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-da5f5adc-c96e-409d-921f-144d759514bd tempest-GroupsTest-1117240337 None] Created volume successfully. Sep 05 20:52:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] group_snapshot 2f4f5bac-093a-4a97-851a-50b167b891d0: deleting Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] group_snapshot 2f4f5bac-093a-4a97-851a-50b167b891d0: deleting {{(pid=87802) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-89aac694-168e-4b03-8d3a-91c4fb51121e" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-89aac694-168e-4b03-8d3a-91c4fb51121e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Deleting offline snapshot 89aac694-168e-4b03-8d3a-91c4fb51121e of volume d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] snapshot_file for this snap is: volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff2c814-10a6-40e2-b7d0-f378a71c5e1c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:41 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e Sep 05 20:52:41 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:41 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e" returned: 0 in 0.415s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e71452-bc55-422a-8edc-7ae8b8b5d155]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:41 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 Sep 05 20:52:41 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-878518de-f652-45a4-94ae-5c1455ae73a8 tempest-GroupsTest-1117240337 None] Update group completed successfully. Sep 05 20:52:42 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" returned: 0 in 0.486s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:42 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e Sep 05 20:52:42 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:42 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e" returned: 0 in 0.387s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:42 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e Sep 05 20:52:42 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:42 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9.89aac694-168e-4b03-8d3a-91c4fb51121e" returned: 0 in 0.275s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-89aac694-168e-4b03-8d3a-91c4fb51121e" released by "_delete_snapshot" :: held 1.700s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" released by "delete_snapshot" :: held 1.737s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:42 devstack cinder-volume[87802]: WARNING cinder.quota [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1440264995 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1440264995, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:42 devstack cinder-volume[87802]: WARNING cinder.quota [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1440264995 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1440264995, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:42 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] Created reservations ['1a537e24-a6d7-430d-b540-385a39b85d7a', 'bd7a5dd4-b82a-4ee5-92a4-764a5b4a17e9', '6b0887d9-f33a-489a-8368-40c3af14d503', 'a1ba6ef1-09e4-4d3d-ab36-9ef2c9730593'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a5a945c7-724c-4948-be69-800b27c1203b tempest-GroupSnapshotsTest-888304146 None] group_snapshot 2f4f5bac-093a-4a97-851a-50b167b891d0: deleted successfully Sep 05 20:52:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0d996a77-29df-4411-9572-6451cd4dfbb1 tempest-GroupsTest-1117240337 None] Update group completed successfully. Sep 05 20:52:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "cinder-quobyte-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:43 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[97451247-2485-4fcd-8544-8760369e16c5]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:43 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 Sep 05 20:52:44 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:44 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" returned: 0 in 0.455s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:44 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9 Sep 05 20:52:44 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:44 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" returned: 0 in 0.363s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Lock "cinder-quobyte-d9016f02-1bcc-4d29-bbe4-0efa12acfcd9" released by "delete_volume" :: held 0.900s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['b6b417ac-d3a0-4e6d-8508-11929dbfa0e4'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:44 devstack cinder-volume[87802]: WARNING cinder.quota [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1440264995 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1440264995, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Created reservations ['7ae08c08-9f7f-481e-aee2-8db7ebd142e3', 'e0079b80-13fe-4f02-94a1-6d6b3facda49', '9b2f1dd9-7514-4484-8981-94926f3c6837', '750f0021-ba0b-4802-9350-0a0bcd55259e'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:44 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:52:44 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Acquiring lock "cinder-quobyte-4b5d7486-125e-4183-8f53-1001c4e75306" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Lock "cinder-quobyte-4b5d7486-125e-4183-8f53-1001c4e75306" acquired by "delete_volume" :: waited 0.047s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:45 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea66868d-9f37-42ff-8270-32beeaba490a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:45 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.477s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:45 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-15563a00-ab8b-47b9-aff5-7a9b47aac3c2 tempest-GroupSnapshotsTest-888304146 None] Delete group completed successfully. Sep 05 20:52:45 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 Sep 05 20:52:45 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:45 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306" returned: 0 in 0.532s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:45 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306 Sep 05 20:52:45 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:46 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4b5d7486-125e-4183-8f53-1001c4e75306" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Lock "cinder-quobyte-4b5d7486-125e-4183-8f53-1001c4e75306" released by "delete_volume" :: held 0.914s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Acquiring lock "cinder-quobyte-f7a57cd5-6e39-4b6e-92ca-88d6990ba131" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Lock "cinder-quobyte-f7a57cd5-6e39-4b6e-92ca-88d6990ba131" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece04a06-3db6-4d18-b719-6ea9dee57b4c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:46 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 Sep 05 20:52:46 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:46 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:46 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131 Sep 05 20:52:46 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:47 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f7a57cd5-6e39-4b6e-92ca-88d6990ba131" returned: 0 in 0.336s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Lock "cinder-quobyte-f7a57cd5-6e39-4b6e-92ca-88d6990ba131" released by "delete_volume" :: held 0.800s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:47 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Created reservations ['99b45a07-d306-4c7f-b0a0-fb816dbb6497'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:47 devstack cinder-volume[87802]: WARNING cinder.quota [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1462235466 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1462235466, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:47 devstack cinder-volume[87802]: WARNING cinder.quota [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1462235466 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1462235466, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a0645de5-2ffe-423c-9c9a-b6682f20ca58 tempest-GroupSnapshotsV319Test-331039249 None] Group tempest-GroupSnapshotsV319Test-Group-1876436594: creating Sep 05 20:52:47 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Created reservations ['28a2dc83-04db-4f92-be5e-ec8408f8077e', '7fe12d1c-895b-4fa6-ae5d-f03834c2f4d1', 'bcf70f3e-a63f-4a28-a02d-f604b72cea17', '9cdc6f20-732f-41f1-bc53-80904f3eca0d'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a0645de5-2ffe-423c-9c9a-b6682f20ca58 tempest-GroupSnapshotsV319Test-331039249 None] Group tempest-GroupSnapshotsV319Test-Group-1876436594: created successfully Sep 05 20:52:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a0645de5-2ffe-423c-9c9a-b6682f20ca58 tempest-GroupSnapshotsV319Test-331039249 None] Create group completed successfully. Sep 05 20:52:47 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Created reservations ['415d54c4-e9d8-4a45-8d05-4f4ff771a65e', '862249f0-29a9-4551-9867-8b9cf2266a37', 'd6053fcc-25cd-4fbf-8c23-13c6f5502977', '24526e64-8a03-4641-9bf1-27cb0164276b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:48 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:52:48 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Flow 'volume_create_manager' (26a2b9d4-8e1f-4e3d-aba5-6aabbe040792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fc17bd-ca71-41b7-93a5-46eac6a06fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fc17bd-ca71-41b7-93a5-46eac6a06fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-231607212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5613e963-f42e-4038-b4c7-16cff69dec8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4c58a646084775a4036f9fa45616d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:48Z,use_quota=True,user_id='92f960f98b7e44c1824e91fa34c99f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc827db-531d-4d06-8db3-d5caca37664f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc827db-531d-4d06-8db3-d5caca37664f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:48 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eca4747-0925-4411-8777-1812992117ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eca4747-0925-4411-8777-1812992117ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5613e963-f42e-4038-b4c7-16cff69dec8f', 'volume_name': 'volume-5613e963-f42e-4038-b4c7-16cff69dec8f', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087609c5-6b41-4511-ac30-36c3c4736689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087609c5-6b41-4511-ac30-36c3c4736689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bf28f0-7b55-49bd-a57d-32e4373baca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Volume 5613e963-f42e-4038-b4c7-16cff69dec8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5613e963-f42e-4038-b4c7-16cff69dec8f', 'volume_size': 1} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-231607212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5613e963-f42e-4038-b4c7-16cff69dec8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4c58a646084775a4036f9fa45616d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:48Z,use_quota=True,user_id='92f960f98b7e44c1824e91fa34c99f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Creating volume 5613e963-f42e-4038-b4c7-16cff69dec8f {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:48 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.391s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:48 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-06c39029-bfcb-4603-9498-15f339f2043a tempest-GroupsTest-1117240337 None] Delete group completed successfully. Sep 05 20:52:48 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f 1073741824 Sep 05 20:52:48 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:49 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f 1073741824" returned: 0 in 0.716s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=192,cinder:SELECT=168,cinder:INSERT=38,cinder:DELETE=6 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=166,cinder:INSERT=48,cinder:UPDATE=185,cinder:DELETE=7 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:49 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:49 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Flow 'volume_create_manager' (b549a170-1f94-4dab-a7d5-f15b21b20bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7602b-1ed2-4cd7-b7b1-20a2c45f6915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7602b-1ed2-4cd7-b7b1-20a2c45f6915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321283869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb20c470-3a7a-4109-a4aa-592737ce1278,host='devstack@QuobyteHD#QuobyteHD',id=25cfb7ee-5e1c-4699-bce9-4237e0d33853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67766bb91e84b8699d63e90d1ee22b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:49Z,use_quota=True,user_id='1750c7fe22a946039257f23184fe206d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed570252-0eec-4f6a-8c50-c3a39ed6ac16),volume_type_id=ed570252-0eec-4f6a-8c50-c3a39ed6ac16)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9801022c-af9d-4691-af15-55471e48d90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9801022c-af9d-4691-af15-55471e48d90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b859a4d8-2613-4f4a-aa58-60227a260ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b859a4d8-2613-4f4a-aa58-60227a260ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cfb7ee-5e1c-4699-bce9-4237e0d33853', 'volume_name': 'volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83e9349-09b6-4d41-9e0b-c64bde1c0d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83e9349-09b6-4d41-9e0b-c64bde1c0d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74abd3ce-13fb-4a1d-b458-00578834569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:49 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Volume 25cfb7ee-5e1c-4699-bce9-4237e0d33853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853', 'volume_size': 1} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:49 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f" returned: 0 in 0.386s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.235s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb20c470-3a7a-4109-a4aa-592737ce1278,created_at=2026-09-05T18:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321283869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb20c470-3a7a-4109-a4aa-592737ce1278,host='devstack@QuobyteHD#QuobyteHD',id=25cfb7ee-5e1c-4699-bce9-4237e0d33853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67766bb91e84b8699d63e90d1ee22b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:49Z,use_quota=True,user_id='1750c7fe22a946039257f23184fe206d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed570252-0eec-4f6a-8c50-c3a39ed6ac16),volume_type_id=ed570252-0eec-4f6a-8c50-c3a39ed6ac16)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Creating volume 25cfb7ee-5e1c-4699-bce9-4237e0d33853 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:49 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:49 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 1073741824 Sep 05 20:52:49 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bf28f0-7b55-49bd-a57d-32e4373baca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5613e963-f42e-4038-b4c7-16cff69dec8f', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8336c2-92dc-4e4d-9f78-2a1fe1676b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:49 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Volume volume-5613e963-f42e-4038-b4c7-16cff69dec8f (5613e963-f42e-4038-b4c7-16cff69dec8f): created successfully Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8336c2-92dc-4e4d-9f78-2a1fe1676b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Flow 'volume_create_manager' (26a2b9d4-8e1f-4e3d-aba5-6aabbe040792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-029884c7-2fe5-4af0-942e-47d520e3d2ea tempest-AttachVolumeShelveTestJSON-1575243103 None] Created volume successfully. Sep 05 20:52:50 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 1073741824" returned: 0 in 0.612s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:50 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 Sep 05 20:52:50 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:50 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853" returned: 0 in 0.362s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74abd3ce-13fb-4a1d-b458-00578834569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016bf25c-f973-49f4-8a07-5fa6d14d3023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:50 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Volume volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 (25cfb7ee-5e1c-4699-bce9-4237e0d33853): created successfully Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016bf25c-f973-49f4-8a07-5fa6d14d3023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Flow 'volume_create_manager' (b549a170-1f94-4dab-a7d5-f15b21b20bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-67b2e893-312b-4fde-9846-534a3a558949 tempest-GroupSnapshotsV319Test-331039249 None] Created volume successfully. Sep 05 20:52:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] GroupSnapshot 64bfc11f-e436-4e3f-822d-1b1b364bed8c: creating. Sep 05 20:52:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Group snapshot 64bfc11f-e436-4e3f-822d-1b1b364bed8c: creating. {{(pid=87802) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 20:52:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Creating offline snapshot cd2251a3-2cea-419b-8fc5-ba12d81f75ad of volume 25cfb7ee-5e1c-4699-bce9-4237e0d33853 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:52:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe7282-9a70-4e53-bc84-d2bec9ba7bc6]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:52 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 Sep 05 20:52:52 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:53 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853" returned: 0 in 0.483s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:53 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad 1G Sep 05 20:52:53 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:53 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad 1G" returned: 0 in 0.791s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:53 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad Sep 05 20:52:53 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:54 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad" returned: 0 in 0.541s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:54 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:54 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad Sep 05 20:52:54 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:54 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad" returned: 0 in 0.279s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:54 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.info Sep 05 20:52:54 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:55 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.info" returned: 0 in 0.358s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:55 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-30b7fc0a-4e3c-4045-903c-faef115191bd tempest-GroupsV314Test-140713042 None] Group tempest-GroupsV314Test-Group-1933175911: creating Sep 05 20:52:55 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.info Sep 05 20:52:55 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-30b7fc0a-4e3c-4045-903c-faef115191bd tempest-GroupsV314Test-140713042 None] Group tempest-GroupsV314Test-Group-1933175911: created successfully Sep 05 20:52:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-30b7fc0a-4e3c-4045-903c-faef115191bd tempest-GroupsV314Test-140713042 None] Create group completed successfully. Sep 05 20:52:55 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.info" returned: 0 in 0.362s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-70d963bc-1d50-4fe4-baca-4d8b2ee355b4 tempest-GroupSnapshotsV319Test-331039249 None] group_snapshot 64bfc11f-e436-4e3f-822d-1b1b364bed8c: created successfully Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:55 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:52:55 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:56 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:52:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] group_snapshot 64bfc11f-e436-4e3f-822d-1b1b364bed8c: deleting Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] group_snapshot 64bfc11f-e436-4e3f-822d-1b1b364bed8c: deleting {{(pid=87802) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Acquiring lock "cinder-quobyte-25cfb7ee-5e1c-4699-bce9-4237e0d33853" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Lock "cinder-quobyte-25cfb7ee-5e1c-4699-bce9-4237e0d33853" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Acquiring lock "cinder-quobyte-cd2251a3-2cea-419b-8fc5-ba12d81f75ad" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Lock "cinder-quobyte-cd2251a3-2cea-419b-8fc5-ba12d81f75ad" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Deleting offline snapshot cd2251a3-2cea-419b-8fc5-ba12d81f75ad of volume 25cfb7ee-5e1c-4699-bce9-4237e0d33853 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] snapshot_file for this snap is: volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[388097d2-2732-48fe-82f7-a993617a102f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:57 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad Sep 05 20:52:57 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Flow 'volume_create_manager' (cddbf34a-dbe6-4b85-8254-079458eecad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce39fc61-c7af-492a-914c-86275356662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce39fc61-c7af-492a-914c-86275356662e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1910266424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1801d76c-b17d-4455-b24c-52c7e4821a74,host='devstack@QuobyteHD#QuobyteHD',id=0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='541ab37653d3419e816894795c006f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:57Z,use_quota=True,user_id='66bbfdfaac0648fa8b14a34edf25aba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b928f57-70da-48cb-9714-09f72c70800f),volume_type_id=2b928f57-70da-48cb-9714-09f72c70800f)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:57 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed17c9fe-6229-4213-8701-86636df50e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed17c9fe-6229-4213-8701-86636df50e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44012d6-3c1c-486e-8d20-1e6ac8817a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44012d6-3c1c-486e-8d20-1e6ac8817a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4', 'volume_name': 'volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335429c1-7c60-4a13-b98c-ab4e1ec640e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335429c1-7c60-4a13-b98c-ab4e1ec640e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978141fd-517f-4178-b5da-4db0d9e1b61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:57 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Volume 0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4', 'volume_size': 1} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1801d76c-b17d-4455-b24c-52c7e4821a74,created_at=2026-09-05T18:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1910266424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1801d76c-b17d-4455-b24c-52c7e4821a74,host='devstack@QuobyteHD#QuobyteHD',id=0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='541ab37653d3419e816894795c006f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:57Z,use_quota=True,user_id='66bbfdfaac0648fa8b14a34edf25aba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b928f57-70da-48cb-9714-09f72c70800f),volume_type_id=2b928f57-70da-48cb-9714-09f72c70800f)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Creating volume 0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:57 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad" returned: 0 in 0.669s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:57 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 1073741824 Sep 05 20:52:57 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[436af66c-f58c-4e61-a164-3ecd13246005]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:57 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 Sep 05 20:52:57 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:58 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853" returned: 0 in 0.508s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:58 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad Sep 05 20:52:58 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:58 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 1073741824" returned: 0 in 0.654s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:58 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 Sep 05 20:52:58 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:58 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" returned: 0 in 0.400s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:58 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978141fd-517f-4178-b5da-4db0d9e1b61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f9c997-030d-4e69-8f44-c6eb5686d5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad" returned: 0 in 0.604s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:58 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Volume volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 (0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4): created successfully Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f9c997-030d-4e69-8f44-c6eb5686d5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:58 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad Sep 05 20:52:58 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Flow 'volume_create_manager' (cddbf34a-dbe6-4b85-8254-079458eecad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:58 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b64a277a-1930-4f5f-8e9e-faa6dcc3c05c tempest-GroupsV314Test-140713042 None] Created volume successfully. Sep 05 20:52:58 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853.cd2251a3-2cea-419b-8fc5-ba12d81f75ad" returned: 0 in 0.294s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Lock "cinder-quobyte-cd2251a3-2cea-419b-8fc5-ba12d81f75ad" released by "_delete_snapshot" :: held 2.256s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Lock "cinder-quobyte-25cfb7ee-5e1c-4699-bce9-4237e0d33853" released by "delete_snapshot" :: held 2.309s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:59 devstack cinder-volume[87802]: WARNING cinder.quota [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1586254092 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1586254092, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:59 devstack cinder-volume[87802]: WARNING cinder.quota [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1586254092 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1586254092, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] Created reservations ['8e71d306-6cf6-4d24-866b-ae32be25c200', '57ae1501-6e02-4e98-a9a0-76feb16a2c59', 'd57fa183-c923-4e1e-b605-fad428e5fae9', 'bcbf76af-69fe-4c1e-904b-cf5ed49b90d2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Flow 'volume_create_manager' (8548d07d-349e-40de-8122-04ac4187d478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af074c2-2d17-406d-9fd7-44ed0ecf199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af074c2-2d17-406d-9fd7-44ed0ecf199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1909763771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1c631a-2f97-40e4-8c71-ea23a3a7195c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a407257ce65489582c7a87f445c0ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:59Z,use_quota=True,user_id='9a5eb484791140779c47552c458b10b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffc9239-8335-4d6b-a641-9bd755ea53e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffc9239-8335-4d6b-a641-9bd755ea53e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b17077-1c5a-4191-bb63-f16f487f813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b17077-1c5a-4191-bb63-f16f487f813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1c631a-2f97-40e4-8c71-ea23a3a7195c', 'volume_name': 'volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a348434f-739b-4c08-929f-ab4ba5dccbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a348434f-739b-4c08-929f-ab4ba5dccbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddbeeb8-3941-4854-8c5a-e15e4de46c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c', 'volume_size': 1} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1909763771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1c631a-2f97-40e4-8c71-ea23a3a7195c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a407257ce65489582c7a87f445c0ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:59Z,use_quota=True,user_id='9a5eb484791140779c47552c458b10b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Creating volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:52:59 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:59 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c 1073741824 Sep 05 20:52:59 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b5235d67-2c8d-4de8-b8e4-069010b1f432 tempest-GroupSnapshotsV319Test-331039249 None] group_snapshot 64bfc11f-e436-4e3f-822d-1b1b364bed8c: deleted successfully Sep 05 20:52:59 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c 1073741824" returned: 0 in 0.532s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:59 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c Sep 05 20:52:59 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:00 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" returned: 0 in 0.293s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddbeeb8-3941-4854-8c5a-e15e4de46c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ae9b80-9dae-4b6d-b023-615f59c68ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:00 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Volume volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c (1a1c631a-2f97-40e4-8c71-ea23a3a7195c): created successfully Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ae9b80-9dae-4b6d-b023-615f59c68ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Flow 'volume_create_manager' (8548d07d-349e-40de-8122-04ac4187d478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-25278d04-9e95-401b-a4e5-1da2a7818931 tempest-SnapshotsActionsTest-1577645542 None] Created volume successfully. Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Acquiring lock "cinder-quobyte-25cfb7ee-5e1c-4699-bce9-4237e0d33853" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Lock "cinder-quobyte-25cfb7ee-5e1c-4699-bce9-4237e0d33853" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3772df-84dd-4028-8ddf-98ff2fd9cb77]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:00 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Cloning volume 0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 to volume e9cdce99-08ca-47bb-9b53-038a104cbfd6 Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Creating offline snapshot cda9892c-90e2-4829-b209-066630a4af6c of volume 0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:53:00 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 Sep 05 20:53:00 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d7430d-9af8-4a9b-8a0d-1523261ca968]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:01 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 Sep 05 20:53:01 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:01 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853" returned: 0 in 0.528s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:01 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853 Sep 05 20:53:01 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:01 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" returned: 0 in 0.548s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:01 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c 1G Sep 05 20:53:01 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:01 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25cfb7ee-5e1c-4699-bce9-4237e0d33853" returned: 0 in 0.358s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Lock "cinder-quobyte-25cfb7ee-5e1c-4699-bce9-4237e0d33853" released by "delete_volume" :: held 0.980s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Created reservations ['fe41dba3-bb61-4432-88e2-707120cfd4b5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:01 devstack cinder-volume[87802]: WARNING cinder.quota [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1586254092 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1586254092, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Created reservations ['8357b7b7-9dfa-4df2-80cd-073407b1e6f3', '51e0716d-db69-4742-9bb0-dac87ed501cc', '6b25a9e0-c6e2-48c3-a6fe-96f016feeb27', '8d5a70a3-abaf-4927-9028-2e26a2dfbc44'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:01 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:53:01 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:02 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c 1G" returned: 0 in 0.615s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:02 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c Sep 05 20:53:02 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-058eb7e3-64c3-43e7-be11-276e964a6a19 req-9d0879e4-9267-4bd4-8c24-d90c1fb0141e tempest-AttachVolumeShelveTestJSON-1575243103 None] No connector for attachment 8706d076-fe3b-4353-b32a-6d81e38eec2b; skipping storage backend terminate_connection call. {{(pid=87802) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-058eb7e3-64c3-43e7-be11-276e964a6a19 req-9d0879e4-9267-4bd4-8c24-d90c1fb0141e tempest-AttachVolumeShelveTestJSON-1575243103 None] Deleting attachment 8706d076-fe3b-4353-b32a-6d81e38eec2b. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:53:02 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.271s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:02 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ef655375-96cd-41ce-8d17-718160677f40 tempest-GroupSnapshotsV319Test-331039249 None] Delete group completed successfully. Sep 05 20:53:02 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c" returned: 0 in 0.320s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:02 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:02 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c Sep 05 20:53:02 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:02 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c" returned: 0 in 0.330s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:02 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.info Sep 05 20:53:02 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:03 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.info" returned: 0 in 0.296s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:03 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:03 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.info Sep 05 20:53:03 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:03 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.info" returned: 0 in 0.258s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Acquiring lock "cinder-quobyte-e9cdce99-08ca-47bb-9b53-038a104cbfd6" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Lock "cinder-quobyte-e9cdce99-08ca-47bb-9b53-038a104cbfd6" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] snapshot: cda9892c-90e2-4829-b209-066630a4af6c, volume: e9cdce99-08ca-47bb-9b53-038a104cbfd6, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb45c0da-2bbb-4bf3-9ce1-9d470fb852c1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:03 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c Sep 05 20:53:03 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:03 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c" returned: 0 in 0.453s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fd12eb-b19c-4ac9-820c-2252a359604a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:04 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 Sep 05 20:53:04 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:04 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" returned: 0 in 0.511s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 20:53:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 20:53:04 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:53:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:04 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 Sep 05 20:53:04 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:10 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6" returned: 0 in 6.082s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:53:10 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Converted 1024.00 MB image at 168.32 MB/s Sep 05 20:53:10 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:10 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 Sep 05 20:53:10 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:10 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6" returned: 0 in 0.343s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Lock "cinder-quobyte-e9cdce99-08ca-47bb-9b53-038a104cbfd6" released by "_copy_volume_from_snapshot" :: held 7.516s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Acquiring lock "cinder-quobyte-cda9892c-90e2-4829-b209-066630a4af6c" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Lock "cinder-quobyte-cda9892c-90e2-4829-b209-066630a4af6c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Deleting offline snapshot cda9892c-90e2-4829-b209-066630a4af6c of volume 0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] snapshot_file for this snap is: volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88a8c91-d22c-4b8c-b613-e3f02e76e7a4]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:11 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c Sep 05 20:53:11 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:11 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c" returned: 0 in 0.488s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:11 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2866533-7c78-43b8-ad03-b0b705a8d278]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:11 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 Sep 05 20:53:11 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:12 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" returned: 0 in 0.562s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:12 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c Sep 05 20:53:12 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:12 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c" returned: 0 in 0.401s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:12 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c Sep 05 20:53:12 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:12 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4.cda9892c-90e2-4829-b209-066630a4af6c" returned: 0 in 0.263s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=41,cinder:SELECT=33,cinder:INSERT=7 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Lock "cinder-quobyte-cda9892c-90e2-4829-b209-066630a4af6c" released by "_delete_snapshot" :: held 1.837s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.985s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.056s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Creating offline snapshot 2289b73a-4f5a-4d55-bbc5-42eedb4acf96 of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7305a168-44b5-4106-ad3f-3395a5b8d259]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:12 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7ff8dfbd-6ef8-4763-a7e8-be242e334cdd tempest-GroupsV314Test-140713042 None] Create group from source-group-1801d76c-b17d-4455-b24c-52c7e4821a74 completed successfully. Sep 05 20:53:13 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c Sep 05 20:53:13 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:13 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" returned: 0 in 0.568s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:13 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 1G Sep 05 20:53:13 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Acquiring lock "cinder-quobyte-e9cdce99-08ca-47bb-9b53-038a104cbfd6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Lock "cinder-quobyte-e9cdce99-08ca-47bb-9b53-038a104cbfd6" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafdefbd-4bc5-42b5-aa17-3ecf8fabecfc]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:13 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 Sep 05 20:53:13 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:14 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 1G" returned: 0 in 0.738s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:14 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:14 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:14 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6" returned: 0 in 0.519s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:14 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6 Sep 05 20:53:14 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:14 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.444s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:14 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 is being set with open permissions: ugo+rw Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:14 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e9cdce99-08ca-47bb-9b53-038a104cbfd6" returned: 0 in 0.367s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:14 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:14 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Lock "cinder-quobyte-e9cdce99-08ca-47bb-9b53-038a104cbfd6" released by "delete_volume" :: held 0.983s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Created reservations ['2b7c1876-a354-4177-8e0e-896b96100cba'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:14 devstack cinder-volume[87802]: WARNING cinder.quota [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1215948377 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1215948377, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:53:14 devstack cinder-volume[87802]: WARNING cinder.quota [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1215948377 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1215948377, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:53:14 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Created reservations ['e59e194e-6f71-404f-917a-33a97bfa164a', '3ffe63fa-049e-43ee-9a11-a0b15ecba61a', 'e318aeb9-8c86-4753-96ba-43db4490fdcc', '3d34a777-8044-4cf3-9988-0676b4b8ddab'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:15 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:15 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.484s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:15 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:15 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.info Sep 05 20:53:15 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:15 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.458s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:15 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0680888f-c496-4675-91a0-83cbf9f31404 tempest-GroupsV314Test-140713042 None] Delete group completed successfully. Sep 05 20:53:15 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.info" returned: 0 in 0.518s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:15 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.info is being set with open permissions: ugo+rw Sep 05 20:53:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:15 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.info Sep 05 20:53:15 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:16 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.info" returned: 0 in 0.414s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.323s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-44998e7e-f980-414a-9f74-ac5404b6eb4a tempest-SnapshotsActionsTest-1577645542 None] Create snapshot completed successfully Sep 05 20:53:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Acquiring lock "cinder-quobyte-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Lock "cinder-quobyte-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" acquired by "delete_volume" :: waited 0.073s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:16 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f0b54c-f297-4c57-94ca-358810976f31]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:16 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 Sep 05 20:53:16 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:17 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" returned: 0 in 0.601s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:17 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4 Sep 05 20:53:17 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:17 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" returned: 0 in 0.479s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Lock "cinder-quobyte-0c4ba278-dd2a-4d4d-b9ab-cbdd667ff1f4" released by "delete_volume" :: held 1.208s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:17 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Created reservations ['31bb1505-4171-4df5-8653-f3b4a78f00f5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Creating offline snapshot db2212ca-0593-40e8-abc4-53015db577ef of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Created reservations ['c5057cc5-8a24-4cf6-ad78-3acc9799d363', 'bad502e6-d9ac-4d8e-bb95-1adb19c475ea', '4db2c1e6-b42a-4b33-a0c1-91ee444f908e', '0044e3d8-4f44-4848-a9ec-7315fcecefd1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b9a42e-afe8-4a2e-a961-b99a157993f1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:18 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:18 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:18 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:53:18 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:18 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.565s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:18 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef 1G Sep 05 20:53:18 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:18 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.459s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:18 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-955638fd-0f5b-4da2-b18c-601cf9b3110a tempest-GroupsV314Test-140713042 None] Delete group completed successfully. Sep 05 20:53:19 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef 1G" returned: 0 in 0.605s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:19 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef Sep 05 20:53:19 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:19 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef" returned: 0 in 0.444s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:19 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef is being set with open permissions: ugo+rw Sep 05 20:53:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:19 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef Sep 05 20:53:19 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:20 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef" returned: 0 in 0.347s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3a538c04-bdef-41d9-9ab4-ecbe322bb054 tempest-SnapshotsActionsTest-1577645542 None] Create snapshot completed successfully Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-db2212ca-0593-40e8-abc4-53015db577ef-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-db2212ca-0593-40e8-abc4-53015db577ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-quobyte-db2212ca-0593-40e8-abc4-53015db577ef" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-db2212ca-0593-40e8-abc4-53015db577ef" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Deleting offline snapshot db2212ca-0593-40e8-abc4-53015db577ef of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] snapshot_file for this snap is: volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf097a-f345-4b14-992d-8dc086b36902]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:21 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef Sep 05 20:53:21 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:22 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef" returned: 0 in 0.625s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:22 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[987d680e-b758-4f8a-9c40-4afd66b2d98d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:22 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:22 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:22 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.475s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:22 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef Sep 05 20:53:22 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:23 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef" returned: 0 in 0.567s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:23 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef Sep 05 20:53:23 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:23 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.db2212ca-0593-40e8-abc4-53015db577ef" returned: 0 in 0.311s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-db2212ca-0593-40e8-abc4-53015db577ef" released by "_delete_snapshot" :: held 2.125s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" released by "delete_snapshot" :: held 2.165s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:23 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Created reservations ['e65d1f27-d37f-47c0-b79d-8ef896b77319', '3f7487f0-d8c3-4de2-8f88-d72bf15a5a14', '40961a68-e67e-4b76-a424-54418a21f962', 'f7f114ac-e1a6-45ed-8097-0bb2a1ebe4c5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Delete snapshot completed successfully. Sep 05 20:53:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f77682ff-a5cf-4b9a-9f3a-6ba03a654ad6 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-db2212ca-0593-40e8-abc4-53015db577ef-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Creating offline snapshot be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:53:25 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdf3030-1653-425b-9ce6-45ec2e36bb44]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:25 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:25 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:26 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.623s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:26 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 1G Sep 05 20:53:26 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:26 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 1G" returned: 0 in 0.611s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:26 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 Sep 05 20:53:26 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:27 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15" returned: 0 in 0.429s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:27 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 is being set with open permissions: ugo+rw Sep 05 20:53:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:27 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 Sep 05 20:53:27 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:27 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15" returned: 0 in 0.355s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0be30fee-41ca-496f-8111-d303b3ba88d9 tempest-SnapshotsActionsTest-1577645542 None] Create snapshot completed successfully Sep 05 20:53:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b2de1e79-be79-4a0f-8583-3471c744bef4 tempest-GroupsV320Test-1903319576 None] Group tempest-GroupsV320Test-Group-1883176657: creating Sep 05 20:53:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b2de1e79-be79-4a0f-8583-3471c744bef4 tempest-GroupsV320Test-1903319576 None] Group tempest-GroupsV320Test-Group-1883176657: created successfully Sep 05 20:53:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b2de1e79-be79-4a0f-8583-3471c744bef4 tempest-GroupsV320Test-1903319576 None] Create group completed successfully. Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-be0a557d-11eb-4a6e-b078-5eb5ea7ccc15-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-be0a557d-11eb-4a6e-b078-5eb5ea7ccc15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-quobyte-be0a557d-11eb-4a6e-b078-5eb5ea7ccc15" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-be0a557d-11eb-4a6e-b078-5eb5ea7ccc15" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Deleting offline snapshot be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] snapshot_file for this snap is: volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[31627373-0983-42dd-9566-3272e8107da9]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:29 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 Sep 05 20:53:29 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:29 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15" returned: 0 in 0.430s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:29 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3f0fc0-a287-4ba0-bc77-b087b927cef9]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:29 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:29 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:29 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.542s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:29 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 Sep 05 20:53:29 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Created reservations ['e8d62dec-5dc0-4590-a92b-2e585ee7d0be'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:30 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:53:30 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:30 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15" returned: 0 in 0.511s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:30 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15 Sep 05 20:53:30 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:30 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.271s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6d392c0b-cc09-4184-9a07-68f25a8da502 tempest-GroupsV320Test-1903319576 None] Delete group completed successfully. Sep 05 20:53:30 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.be0a557d-11eb-4a6e-b078-5eb5ea7ccc15" returned: 0 in 0.281s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-be0a557d-11eb-4a6e-b078-5eb5ea7ccc15" released by "_delete_snapshot" :: held 1.879s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" released by "delete_snapshot" :: held 1.904s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Created reservations ['0afa8c5a-eec1-4586-b2dc-9125630e91b8', 'cd391cf0-713f-4167-b83e-f2b045828e96', '82fd0959-3f2b-421c-a682-70898605b17b', '3f6b90e1-f0f4-44bc-bb87-c2b710257885'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Delete snapshot completed successfully. Sep 05 20:53:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0cf855d8-036d-40d3-9a84-51841e51957c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-be0a557d-11eb-4a6e-b078-5eb5ea7ccc15-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Creating offline snapshot 47f8e7d3-df56-49f3-a716-949d3c9b4cd2 of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:53:31 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1400d3-effe-49b0-aeea-7caff39b395f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:31 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:31 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:31 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.412s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:31 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 1G Sep 05 20:53:31 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:32 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 1G" returned: 0 in 0.498s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:32 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 Sep 05 20:53:32 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:32 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2" returned: 0 in 0.342s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:32 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 is being set with open permissions: ugo+rw Sep 05 20:53:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:32 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 Sep 05 20:53:32 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:32 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2" returned: 0 in 0.279s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.660s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:33 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-24adb51c-de65-443c-892c-1e3d2d73e7a1 tempest-SnapshotsActionsTest-1577645542 None] Create snapshot completed successfully Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-47f8e7d3-df56-49f3-a716-949d3c9b4cd2-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-47f8e7d3-df56-49f3-a716-949d3c9b4cd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-quobyte-47f8e7d3-df56-49f3-a716-949d3c9b4cd2" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-47f8e7d3-df56-49f3-a716-949d3c9b4cd2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Deleting offline snapshot 47f8e7d3-df56-49f3-a716-949d3c9b4cd2 of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] snapshot_file for this snap is: volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3917adb8-ca8d-4a67-bed1-7aa0f0c9ba71]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:33 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 Sep 05 20:53:33 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:34 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2" returned: 0 in 0.426s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:34 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4155a2f-7b12-4397-b17f-a6ec763a4067]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:34 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:34 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:34 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.483s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:34 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 Sep 05 20:53:34 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:35 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2" returned: 0 in 0.511s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:35 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2 Sep 05 20:53:35 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:35 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.47f8e7d3-df56-49f3-a716-949d3c9b4cd2" returned: 0 in 0.282s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-47f8e7d3-df56-49f3-a716-949d3c9b4cd2" released by "_delete_snapshot" :: held 1.829s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" released by "delete_snapshot" :: held 1.863s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:35 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Created reservations ['5e8d223f-262c-4802-93eb-975f948411e6', '8eff7eaf-a4e1-4222-a485-8f3cd33a003f', 'e79063d6-0dc5-411f-8f05-04a9c8741703', 'b96abdca-283c-4433-b6ab-931a49ebb5e3'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Delete snapshot completed successfully. Sep 05 20:53:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21874f47-1f52-40de-a63d-75f480fc540c tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-47f8e7d3-df56-49f3-a716-949d3c9b4cd2-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Creating offline snapshot 9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:53:36 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f2dac9-1aaf-4c91-9ef5-cd1fc78dc31a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:36 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:36 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:36 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.507s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:36 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 1G Sep 05 20:53:36 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:37 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 1G" returned: 0 in 0.616s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:37 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 Sep 05 20:53:37 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:37 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690" returned: 0 in 0.500s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:37 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 is being set with open permissions: ugo+rw Sep 05 20:53:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:37 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 Sep 05 20:53:37 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:38 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690" returned: 0 in 0.369s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6de840c5-9204-4da0-92d7-cee61e85d9b4 tempest-SnapshotsActionsTest-1577645542 None] Create snapshot completed successfully Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-9ccee7a8-f95b-410b-8dcb-2f9e6ed99690-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-9ccee7a8-f95b-410b-8dcb-2f9e6ed99690-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Acquiring lock "cinder-quobyte-9ccee7a8-f95b-410b-8dcb-2f9e6ed99690" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-9ccee7a8-f95b-410b-8dcb-2f9e6ed99690" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Deleting offline snapshot 9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] snapshot_file for this snap is: volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[281210a1-666e-42cf-beae-b37cc234e80e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:39 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 Sep 05 20:53:39 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:39 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:53:39 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Flow 'volume_create_manager' (fc93f4ea-5de7-4850-a27d-9dd004bf7b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bfce7a-4f40-406c-9ee2-2c422a118d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690" returned: 0 in 0.442s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bfce7a-4f40-406c-9ee2-2c422a118d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2014192381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f86712-e8a1-4017-b72e-b3a1cca2a37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ed87ededb2433cb8e3003274334c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:40Z,use_quota=True,user_id='4d6c6b63782a42168d811ff45ba647ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9cac8b-3e1c-4dfb-b93b-4974a04ec8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9cac8b-3e1c-4dfb-b93b-4974a04ec8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafc1fe7-ec42-4e0b-ae25-a5012d6aeb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafc1fe7-ec42-4e0b-ae25-a5012d6aeb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f86712-e8a1-4017-b72e-b3a1cca2a37a', 'volume_name': 'volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef753695-71b6-445d-92ce-9356a3618c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef753695-71b6-445d-92ce-9356a3618c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4023ab-dd93-410b-9570-5c382b36e920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:40 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Volume e8f86712-e8a1-4017-b72e-b3a1cca2a37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a', 'volume_size': 1} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2014192381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f86712-e8a1-4017-b72e-b3a1cca2a37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ed87ededb2433cb8e3003274334c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:40Z,use_quota=True,user_id='4d6c6b63782a42168d811ff45ba647ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Creating volume e8f86712-e8a1-4017-b72e-b3a1cca2a37a {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:53:40 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087e39a-02e5-49b0-b50f-c3aa79cdf727]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:40 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a 1073741824 Sep 05 20:53:40 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:40 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:40 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:40 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.382s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:40 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 Sep 05 20:53:40 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:40 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a 1073741824" returned: 0 in 0.500s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:40 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a Sep 05 20:53:40 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:40 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a" returned: 0 in 0.345s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:53:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4023ab-dd93-410b-9570-5c382b36e920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb33129c-1015-4d00-9f04-801927c5cf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Volume volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a (e8f86712-e8a1-4017-b72e-b3a1cca2a37a): created successfully Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb33129c-1015-4d00-9f04-801927c5cf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Flow 'volume_create_manager' (fc93f4ea-5de7-4850-a27d-9dd004bf7b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:41 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690" returned: 0 in 0.563s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7a262b4e-2dde-4f5a-b0f4-83233227865b tempest-VolumesServicesTestJSON-723203399 None] Created volume successfully. Sep 05 20:53:41 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690 Sep 05 20:53:41 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:41 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.9ccee7a8-f95b-410b-8dcb-2f9e6ed99690" returned: 0 in 0.337s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-9ccee7a8-f95b-410b-8dcb-2f9e6ed99690" released by "_delete_snapshot" :: held 1.905s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" released by "delete_snapshot" :: held 1.942s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Created reservations ['c26879c3-8b8c-4187-8bc0-001f56e1fb02', 'e07b9952-a61c-452a-9085-08a7910d7020', '3dda52a0-addb-4c3b-9c11-29eb9d65b2ea', 'ff8fafe8-be12-45a5-82b7-6a9d9bec9793'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Delete snapshot completed successfully. Sep 05 20:53:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-00595a75-0df9-4376-8338-79226aaa4b65 tempest-SnapshotsActionsTest-2015768461 None] Lock "cinder-9ccee7a8-f95b-410b-8dcb-2f9e6ed99690-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Acquiring lock "cinder-e8f86712-e8a1-4017-b72e-b3a1cca2a37a-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Lock "cinder-e8f86712-e8a1-4017-b72e-b3a1cca2a37a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Acquiring lock "cinder-quobyte-e8f86712-e8a1-4017-b72e-b3a1cca2a37a" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Lock "cinder-quobyte-e8f86712-e8a1-4017-b72e-b3a1cca2a37a" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:42 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95914b1-3e2f-43b8-9a44-0fbec583f490]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:42 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a Sep 05 20:53:42 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:43 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a" returned: 0 in 0.642s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:43 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a Sep 05 20:53:43 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "cinder-2289b73a-4f5a-4d55-bbc5-42eedb4acf96-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-2289b73a-4f5a-4d55-bbc5-42eedb4acf96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "cinder-quobyte-2289b73a-4f5a-4d55-bbc5-42eedb4acf96" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-quobyte-2289b73a-4f5a-4d55-bbc5-42eedb4acf96" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Deleting offline snapshot 2289b73a-4f5a-4d55-bbc5-42eedb4acf96 of volume 1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] snapshot_file for this snap is: volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[169ef48f-9858-4c79-9b6f-59c495ac8b3f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:43 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e8f86712-e8a1-4017-b72e-b3a1cca2a37a" returned: 0 in 0.498s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Lock "cinder-quobyte-e8f86712-e8a1-4017-b72e-b3a1cca2a37a" released by "delete_volume" :: held 1.208s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:43 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:43 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Created reservations ['e41bd713-338b-4a6f-ba47-0f0b322cb3e4', '42492ac7-f5f2-4bfb-ba38-01540ae0539c', '894d960f-2fa7-4f40-863c-b4ce15ece097', 'bfa8236b-ec44-43fe-8384-b47bf8dd6fe2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:43 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:53:43 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:44 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.474s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad11969-af68-4023-a293-2387b2886526]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:44 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:44 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Deleted volume successfully. Sep 05 20:53:44 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c Sep 05 20:53:44 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ba633d47-65a3-4d32-83b7-9083a77d790a tempest-VolumesServicesTestJSON-723203399 None] Lock "cinder-e8f86712-e8a1-4017-b72e-b3a1cca2a37a-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:44 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" returned: 0 in 0.408s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:44 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:44 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:44 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.436s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:45 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96 Sep 05 20:53:45 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:45 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c.2289b73a-4f5a-4d55-bbc5-42eedb4acf96" returned: 0 in 0.334s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-quobyte-2289b73a-4f5a-4d55-bbc5-42eedb4acf96" released by "_delete_snapshot" :: held 1.844s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" released by "delete_snapshot" :: held 1.881s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:45 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Created reservations ['9091ed71-0dd3-4ad3-83ff-bd20ae431004', 'a668d7e8-779b-4952-b51f-7993071951a4', '8b2a57e7-8eeb-46ce-a6eb-d1dc45da5b5c', '813ed304-c0de-4352-805d-427965adfd1a'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Delete snapshot completed successfully. Sep 05 20:53:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-48dcadbd-c096-4672-937e-bf35d9a34ddc tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-2289b73a-4f5a-4d55-bbc5-42eedb4acf96-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "cinder-1a1c631a-2f97-40e4-8c71-ea23a3a7195c-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-1a1c631a-2f97-40e4-8c71-ea23a3a7195c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43129eb-23bc-4239-bc5d-fc98c8f59551]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:47 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c Sep 05 20:53:47 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Acquiring lock "cinder-5613e963-f42e-4038-b4c7-16cff69dec8f-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "cinder-5613e963-f42e-4038-b4c7-16cff69dec8f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:47 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" returned: 0 in 0.561s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:47 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c Sep 05 20:53:47 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Acquiring lock "cinder-quobyte-5613e963-f42e-4038-b4c7-16cff69dec8f" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "cinder-quobyte-5613e963-f42e-4038-b4c7-16cff69dec8f" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[80963898-2751-430b-a059-92cbc21e0dc4]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:47 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f Sep 05 20:53:47 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:47 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" returned: 0 in 0.403s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-quobyte-1a1c631a-2f97-40e4-8c71-ea23a3a7195c" released by "delete_volume" :: held 1.081s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:47 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Created reservations ['02478d95-cb5d-459f-8ba5-42878067204c', 'c77845fc-5c5f-4086-a0a6-d5f9df75fa28', 'a28bb13a-16df-4961-aabc-a9087da80007', '4452c2cd-92fa-427f-b912-db54e3ee423c'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:48 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f" returned: 0 in 0.519s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:48 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:53:48 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:48 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f Sep 05 20:53:48 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:48 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.345s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Deleted volume successfully. Sep 05 20:53:48 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5613e963-f42e-4038-b4c7-16cff69dec8f" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "cinder-quobyte-5613e963-f42e-4038-b4c7-16cff69dec8f" released by "delete_volume" :: held 0.935s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd787463-b1b7-4ea8-b033-d1678316570f tempest-SnapshotsActionsTest-1577645542 None] Lock "cinder-1a1c631a-2f97-40e4-8c71-ea23a3a7195c-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Created reservations ['a69f5251-cdc3-48e2-9765-dec9c74d5f1b', 'd5559b00-ffbf-4a08-bd61-e1e44a1d8395', '48a1f805-ddf9-435f-b2f5-9cbca98118c6', '1cfb64a7-2c49-4155-9cde-f905806b48f7'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:48 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:53:48 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:49 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.457s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:49 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Deleted volume successfully. Sep 05 20:53:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-09db0a6a-91a9-4fb2-8c2b-aa5ada31402e tempest-AttachVolumeShelveTestJSON-1575243103 None] Lock "cinder-5613e963-f42e-4038-b4c7-16cff69dec8f-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Flow 'volume_create_manager' (79e3ed56-2c87-4a34-9ecb-db4bec1976a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1d5581-19ea-4bbe-ae49-24a5c7658010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=118,cinder:INSERT=27,cinder:UPDATE=114,cinder:DELETE=10 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1d5581-19ea-4bbe-ae49-24a5c7658010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-909216340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3481df-bd0f-46fb-8dbd-174d35e9e106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac99b1a5da245968e267d936fd3dc07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:53Z,use_quota=True,user_id='fc9488ca05d44783a608529017817ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64f595e-0948-482e-b3da-5171023adf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64f595e-0948-482e-b3da-5171023adf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f2bc46-fa08-4072-b4cb-7fe11f5695f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f2bc46-fa08-4072-b4cb-7fe11f5695f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3481df-bd0f-46fb-8dbd-174d35e9e106', 'volume_name': 'volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92dcea29-5450-4327-b57e-75ff70ab594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92dcea29-5450-4327-b57e-75ff70ab594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8509a98-e4c5-4a8e-899a-57568678f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:53 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Volume 5e3481df-bd0f-46fb-8dbd-174d35e9e106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106', 'volume_size': 1} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-909216340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3481df-bd0f-46fb-8dbd-174d35e9e106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac99b1a5da245968e267d936fd3dc07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:53Z,use_quota=True,user_id='fc9488ca05d44783a608529017817ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Creating volume 5e3481df-bd0f-46fb-8dbd-174d35e9e106 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:53:53 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:53:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:53 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 1073741824 Sep 05 20:53:53 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:54 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 1073741824" returned: 0 in 0.527s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:54 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 Sep 05 20:53:54 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:54 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8509a98-e4c5-4a8e-899a-57568678f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6be2278-db9e-4873-984b-7774cf2a6ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Volume volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 (5e3481df-bd0f-46fb-8dbd-174d35e9e106): created successfully Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6be2278-db9e-4873-984b-7774cf2a6ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Flow 'volume_create_manager' (79e3ed56-2c87-4a34-9ecb-db4bec1976a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:54 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6d4cae42-76ae-4e0a-9961-199494738e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Created volume successfully. Sep 05 20:53:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:53:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:53:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:53:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:55 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:53:55 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:55 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.351s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Creating offline snapshot d66e5231-de74-43c7-af21-18f71ca3a610 of volume 5e3481df-bd0f-46fb-8dbd-174d35e9e106 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc1bba-3549-4686-9e0a-1aef07343294]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:56 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 Sep 05 20:53:56 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:56 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106" returned: 0 in 0.559s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:56 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 1G Sep 05 20:53:56 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:57 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 1G" returned: 0 in 0.589s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:57 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 Sep 05 20:53:57 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:57 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610" returned: 0 in 0.628s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:57 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 is being set with open permissions: ugo+rw Sep 05 20:53:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:57 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 Sep 05 20:53:57 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:58 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610" returned: 0 in 0.354s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:58 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.info Sep 05 20:53:58 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:58 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.info" returned: 0 in 0.443s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:58 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.info is being set with open permissions: ugo+rw Sep 05 20:53:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:58 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.info Sep 05 20:53:58 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:59 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.info" returned: 0 in 0.421s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.151s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e6c74378-23b8-44f0-aaed-9a444f302c33 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Create snapshot completed successfully Sep 05 20:54:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "cinder-d66e5231-de74-43c7-af21-18f71ca3a610-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-d66e5231-de74-43c7-af21-18f71ca3a610-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "cinder-quobyte-5e3481df-bd0f-46fb-8dbd-174d35e9e106" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-quobyte-5e3481df-bd0f-46fb-8dbd-174d35e9e106" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "cinder-quobyte-d66e5231-de74-43c7-af21-18f71ca3a610" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-quobyte-d66e5231-de74-43c7-af21-18f71ca3a610" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Deleting offline snapshot d66e5231-de74-43c7-af21-18f71ca3a610 of volume 5e3481df-bd0f-46fb-8dbd-174d35e9e106 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] snapshot_file for this snap is: volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[701caf33-ef38-4ca6-9f1d-c60cea9c5019]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:01 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 Sep 05 20:54:01 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:01 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610" returned: 0 in 0.474s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c6222b-f34a-43ca-8508-71bb12ff7260]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:01 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 Sep 05 20:54:01 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:02 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106" returned: 0 in 0.534s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:02 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 Sep 05 20:54:02 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:02 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610" returned: 0 in 0.533s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:02 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610 Sep 05 20:54:02 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:03 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106.d66e5231-de74-43c7-af21-18f71ca3a610" returned: 0 in 0.333s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-quobyte-d66e5231-de74-43c7-af21-18f71ca3a610" released by "_delete_snapshot" :: held 2.071s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-quobyte-5e3481df-bd0f-46fb-8dbd-174d35e9e106" released by "delete_snapshot" :: held 2.106s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:03 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Created reservations ['8337731f-d2ac-42c4-887a-35dbd5774630', 'ca9056d0-8afd-4f10-8fec-20a8dbf65554', 'f8756d89-83b4-4c73-bff1-ea103f2a47b1', '1361b9f5-10ac-4011-b722-29edd9fbafeb'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Delete snapshot completed successfully. Sep 05 20:54:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50fa1700-4703-41bb-a6ed-fbe56829e7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-d66e5231-de74-43c7-af21-18f71ca3a610-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "cinder-5e3481df-bd0f-46fb-8dbd-174d35e9e106-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-5e3481df-bd0f-46fb-8dbd-174d35e9e106-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "cinder-quobyte-5e3481df-bd0f-46fb-8dbd-174d35e9e106" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-quobyte-5e3481df-bd0f-46fb-8dbd-174d35e9e106" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:04 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b55901d-c607-49d2-ac91-b27773e8fee7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:04 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 Sep 05 20:54:04 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:05 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106" returned: 0 in 0.571s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:05 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106 Sep 05 20:54:05 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:05 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5e3481df-bd0f-46fb-8dbd-174d35e9e106" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-quobyte-5e3481df-bd0f-46fb-8dbd-174d35e9e106" released by "delete_volume" :: held 1.096s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Created reservations ['bdfb46f3-4299-40ab-a9d3-9440ddb129c2', '69ff17e8-f8ee-496d-8151-aef43a6d9aba', '2781e645-fc02-4599-9d37-5e017f42be13', '5d7bf314-f284-426f-89cf-a8a5628a5291'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:05 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:54:05 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:06 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.329s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:06 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:06 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Deleted volume successfully. Sep 05 20:54:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-668e297e-5ae8-4c72-b1e7-3a90100c200d tempest-VolumeSnapshotQuotasNegativeTestJSON-684891154 None] Lock "cinder-5e3481df-bd0f-46fb-8dbd-174d35e9e106-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:15 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=101,cinder:SELECT=92,cinder:INSERT=33,cinder:DELETE=5 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:54:16 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=19,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Flow 'volume_create_manager' (447fe414-9aa7-4d67-8d45-0d573eaf9dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457cecbe-f9de-4f13-bda7-143834df95d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457cecbe-f9de-4f13-bda7-143834df95d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-819506244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6850971e-297d-4a9e-b657-53449f131227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116d10e08da047c7a064a74a09b4a6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:32Z,use_quota=True,user_id='60c222fb6f81466e9bac7a21e315f56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b3c8e9-0f78-4abd-8b41-2bbc203dc54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b3c8e9-0f78-4abd-8b41-2bbc203dc54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7403ff4f-2ef9-4436-98bf-47cf2a42c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7403ff4f-2ef9-4436-98bf-47cf2a42c824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6850971e-297d-4a9e-b657-53449f131227', 'volume_name': 'volume-6850971e-297d-4a9e-b657-53449f131227', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaa16cd-3a9a-45a5-8095-5a5214490056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaa16cd-3a9a-45a5-8095-5a5214490056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d5af1b-fc6e-4340-93d1-3c49302aa2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Volume 6850971e-297d-4a9e-b657-53449f131227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6850971e-297d-4a9e-b657-53449f131227', 'volume_size': 1} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-819506244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6850971e-297d-4a9e-b657-53449f131227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116d10e08da047c7a064a74a09b4a6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:32Z,use_quota=True,user_id='60c222fb6f81466e9bac7a21e315f56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Creating volume 6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:54:31 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:54:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:31 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 1073741824 Sep 05 20:54:31 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:32 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 1073741824" returned: 0 in 1.081s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:33 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 Sep 05 20:54:33 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:33 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227" returned: 0 in 0.769s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d5af1b-fc6e-4340-93d1-3c49302aa2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6850971e-297d-4a9e-b657-53449f131227', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2eca53-4709-4ccf-ae40-049bf5553f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:33 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Volume volume-6850971e-297d-4a9e-b657-53449f131227 (6850971e-297d-4a9e-b657-53449f131227): created successfully Sep 05 20:54:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2eca53-4709-4ccf-ae40-049bf5553f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Flow 'volume_create_manager' (447fe414-9aa7-4d67-8d45-0d573eaf9dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:34 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-889ffb91-4172-4712-b6a4-3ecf41a4a531 tempest-VolumesDeleteCascade-34136379 None] Created volume successfully. Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (adcd786e-1cc7-4759-a51d-71db209b125a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d1b67d-be5b-42a1-bb1d-bcaf5d3da4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d1b67d-be5b-42a1-bb1d-bcaf5d3da4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-492937744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa9570e-084c-44ea-bf53-5eccf76359e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:35Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955ae29f-d508-49b4-a99b-fac71cd3fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955ae29f-d508-49b4-a99b-fac71cd3fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f6dee9-09bb-4a0b-931e-6a99e77c1220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f6dee9-09bb-4a0b-931e-6a99e77c1220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa9570e-084c-44ea-bf53-5eccf76359e2', 'volume_name': 'volume-daa9570e-084c-44ea-bf53-5eccf76359e2', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6607d9d-eb7a-435b-ad3f-0d7c4af7c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6607d9d-eb7a-435b-ad3f-0d7c4af7c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f26d2ea-2be4-4453-b6b3-6eb355d49400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Volume daa9570e-084c-44ea-bf53-5eccf76359e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa9570e-084c-44ea-bf53-5eccf76359e2', 'volume_size': 1} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-492937744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa9570e-084c-44ea-bf53-5eccf76359e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:35Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Creating volume daa9570e-084c-44ea-bf53-5eccf76359e2 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:54:35 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:35 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 1073741824 Sep 05 20:54:35 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:36 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 1073741824" returned: 0 in 0.635s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:36 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 Sep 05 20:54:36 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:36 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2" returned: 0 in 0.556s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.150s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Creating offline snapshot 69e0c386-8e75-4b8d-99ff-4ada4ac08811 of volume 6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f26d2ea-2be4-4453-b6b3-6eb355d49400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa9570e-084c-44ea-bf53-5eccf76359e2', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f78fa9-0123-4197-af50-d4217b59dcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e78c1d8-e61c-4417-bff4-7fa8244f3b28]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:37 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Volume volume-daa9570e-084c-44ea-bf53-5eccf76359e2 (daa9570e-084c-44ea-bf53-5eccf76359e2): created successfully Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f78fa9-0123-4197-af50-d4217b59dcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (adcd786e-1cc7-4759-a51d-71db209b125a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:37 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0d832359-d583-45ed-a8de-5e087db88e13 tempest-VolumesActionsTest-939408965 None] Created volume successfully. Sep 05 20:54:37 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 Sep 05 20:54:37 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50a661b4-60cb-47ba-87ca-6a8be2f9bab1 tempest-VolumesActionsTest-939408965 None] Acquiring lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2" by "attach_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50a661b4-60cb-47ba-87ca-6a8be2f9bab1 tempest-VolumesActionsTest-939408965 None] Lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2" acquired by "attach_volume" :: waited 0.044s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:37 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227" returned: 0 in 0.906s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:38 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 1G Sep 05 20:54:38 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-50a661b4-60cb-47ba-87ca-6a8be2f9bab1 tempest-VolumesActionsTest-939408965 None] Attaching volume daa9570e-084c-44ea-bf53-5eccf76359e2 to instance 0f9d4633-cf9b-4f01-aa0f-9fdeb939f52c at mountpoint /dev/vdb on host None. Sep 05 20:54:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-50a661b4-60cb-47ba-87ca-6a8be2f9bab1 tempest-VolumesActionsTest-939408965 None] Attach volume completed successfully. Sep 05 20:54:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-50a661b4-60cb-47ba-87ca-6a8be2f9bab1 tempest-VolumesActionsTest-939408965 None] Lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2" released by "attach_volume" :: held 0.370s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:39 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 1G" returned: 0 in 1.199s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850971e-297d-4a9e-b657-53449f131227 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:39 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850971e-297d-4a9e-b657-53449f131227 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 Sep 05 20:54:39 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-adc5c4e8-962f-42de-9141-8136f62abdf6 tempest-VolumesActionsTest-1139223140 None] Terminate volume connection completed successfully. Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-adc5c4e8-962f-42de-9141-8136f62abdf6 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-detach_volume" by "detach_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:40 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850971e-297d-4a9e-b657-53449f131227 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811" returned: 0 in 0.844s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:40 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 is being set with open permissions: ugo+rw Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-adc5c4e8-962f-42de-9141-8136f62abdf6 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:40 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 Sep 05 20:54:40 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-adc5c4e8-962f-42de-9141-8136f62abdf6 tempest-VolumesActionsTest-1139223140 None] Detaching volume daa9570e-084c-44ea-bf53-5eccf76359e2 from instance 0f9d4633-cf9b-4f01-aa0f-9fdeb939f52c. Sep 05 20:54:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-adc5c4e8-962f-42de-9141-8136f62abdf6 tempest-VolumesActionsTest-1139223140 None] Detach volume completed successfully. Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-adc5c4e8-962f-42de-9141-8136f62abdf6 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-detach_volume" released by "detach_volume" :: held 0.181s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a12ce60d-f413-4119-9a43-2233975e71dc tempest-VolumesActionsTest-939408965 None] Acquiring lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-detach_volume" by "detach_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a12ce60d-f413-4119-9a43-2233975e71dc tempest-VolumesActionsTest-939408965 None] Lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a12ce60d-f413-4119-9a43-2233975e71dc tempest-VolumesActionsTest-939408965 None] Volume detach called, but volume not attached. Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a12ce60d-f413-4119-9a43-2233975e71dc tempest-VolumesActionsTest-939408965 None] Lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:40 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811" returned: 0 in 0.621s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:40 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.info Sep 05 20:54:40 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Acquiring lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Acquiring lock "cinder-quobyte-daa9570e-084c-44ea-bf53-5eccf76359e2" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Lock "cinder-quobyte-daa9570e-084c-44ea-bf53-5eccf76359e2" acquired by "delete_volume" :: waited 0.051s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:41 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb13733-06b4-4c17-9daa-9a38b56544cb]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:41 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.info" returned: 0 in 0.832s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:41 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.info is being set with open permissions: ugo+rw Sep 05 20:54:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:41 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.info Sep 05 20:54:41 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:41 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 Sep 05 20:54:41 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:42 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.info" returned: 0 in 0.764s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.425s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7ec396a6-bce7-4ea4-8212-e802ada17a81 tempest-VolumesDeleteCascade-34136379 None] Create snapshot completed successfully Sep 05 20:54:42 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2" returned: 0 in 1.063s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:42 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2 Sep 05 20:54:42 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:42 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-daa9570e-084c-44ea-bf53-5eccf76359e2" returned: 0 in 0.308s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Lock "cinder-quobyte-daa9570e-084c-44ea-bf53-5eccf76359e2" released by "delete_volume" :: held 1.473s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Created reservations ['8ddb4cbb-588c-4719-b384-99800e111fec', 'b3b36519-293a-41a5-b98c-fa84e13b52dd', 'ce1d07a0-883d-41bc-b9c0-471f35fe4d16', 'b530b3a0-0f44-4871-9581-7a484f6d9450'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:43 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:54:43 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:43 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.392s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Deleted volume successfully. Sep 05 20:54:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf2f25b7-dd86-4ff1-99c7-2a0c7bd25fe8 tempest-VolumesActionsTest-939408965 None] Lock "cinder-daa9570e-084c-44ea-bf53-5eccf76359e2-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Creating offline snapshot 40f8eeed-9024-43a4-b04f-da982f6c635a of volume 6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:54:44 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb31a1-bebd-49db-88e5-86eb52a7a090]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:44 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 Sep 05 20:54:44 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:44 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811" returned: 0 in 0.761s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6850971e-297d-4a9e-b657-53449f131227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:45 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a 1G Sep 05 20:54:45 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:45 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a 1G" returned: 0 in 0.766s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:45 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a Sep 05 20:54:45 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:46 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a" returned: 0 in 0.543s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:46 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a is being set with open permissions: ugo+rw Sep 05 20:54:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:46 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a Sep 05 20:54:46 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:46 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a" returned: 0 in 0.415s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:46 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-70b52b63-81a2-4e14-a378-4b5a861e5c11 tempest-VolumesDeleteCascade-34136379 None] Create snapshot completed successfully Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-6850971e-297d-4a9e-b657-53449f131227-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-6850971e-297d-4a9e-b657-53449f131227-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Performing cascade delete. {{(pid=87802) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-40f8eeed-9024-43a4-b04f-da982f6c635a-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-40f8eeed-9024-43a4-b04f-da982f6c635a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-40f8eeed-9024-43a4-b04f-da982f6c635a" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-40f8eeed-9024-43a4-b04f-da982f6c635a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Deleting offline snapshot 40f8eeed-9024-43a4-b04f-da982f6c635a of volume 6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] snapshot_file for this snap is: volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e573644-80de-4148-bf20-fb33b8ad93cf]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:47 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a Sep 05 20:54:47 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:48 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a" returned: 0 in 0.398s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6850971e-297d-4a9e-b657-53449f131227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eddbb2f-62d5-4d2b-b13d-66810af9fc0a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:48 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 Sep 05 20:54:48 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:48 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811" returned: 0 in 0.485s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6850971e-297d-4a9e-b657-53449f131227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:48 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a Sep 05 20:54:48 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:49 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (59ad26bb-82d5-4e40-9860-89bc1fd72de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dad1bcc-2587-4aaf-81c3-e4bc9cd88c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a" returned: 0 in 0.565s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dad1bcc-2587-4aaf-81c3-e4bc9cd88c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1917883919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a124dc95-811e-4dda-bc6b-6a40b8c08741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:49Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6a37db-995d-45c0-a35f-90bb0138964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6a37db-995d-45c0-a35f-90bb0138964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:49 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a Sep 05 20:54:49 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73587900-8dd4-421d-ae41-f60d1a142ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73587900-8dd4-421d-ae41-f60d1a142ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a124dc95-811e-4dda-bc6b-6a40b8c08741', 'volume_name': 'volume-a124dc95-811e-4dda-bc6b-6a40b8c08741', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4637745-93a1-44d3-b3e1-819e4fc2643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4637745-93a1-44d3-b3e1-819e4fc2643b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8afab9-d46b-4a0e-a2a2-6615fd54fa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:49 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Volume a124dc95-811e-4dda-bc6b-6a40b8c08741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a124dc95-811e-4dda-bc6b-6a40b8c08741', 'volume_size': 1} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1917883919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a124dc95-811e-4dda-bc6b-6a40b8c08741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:49Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Creating volume a124dc95-811e-4dda-bc6b-6a40b8c08741 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:54:49 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:49 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 1073741824 Sep 05 20:54:49 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:49 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.40f8eeed-9024-43a4-b04f-da982f6c635a" returned: 0 in 0.335s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-40f8eeed-9024-43a4-b04f-da982f6c635a" released by "_delete_snapshot" :: held 1.924s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" released by "delete_snapshot" :: held 1.965s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Created reservations ['27632ec2-5a46-4758-9d54-bc571aa71f52', '8b103f2a-2b07-47db-b329-f5b231207251', '9d6f7be0-c7e5-4f80-bd72-84ff9bb596ee', 'a9840bc5-646a-4ae5-860c-28a8fa9e2890'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Delete snapshot completed successfully. Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-40f8eeed-9024-43a4-b04f-da982f6c635a-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-69e0c386-8e75-4b8d-99ff-4ada4ac08811-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-69e0c386-8e75-4b8d-99ff-4ada4ac08811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-69e0c386-8e75-4b8d-99ff-4ada4ac08811" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-69e0c386-8e75-4b8d-99ff-4ada4ac08811" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Deleting offline snapshot 69e0c386-8e75-4b8d-99ff-4ada4ac08811 of volume 6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] snapshot_file for this snap is: volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:54:49 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 1073741824" returned: 0 in 0.710s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c3bee-0448-4166-b63d-8a95c166901e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:50 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 Sep 05 20:54:50 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Flow 'volume_create_manager' (ed64a1ba-08f0-4c6a-b709-5bfc4d2ab040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:50 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 Sep 05 20:54:50 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cb84d7-148b-4387-8982-aee945b7a83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cb84d7-148b-4387-8982-aee945b7a83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1595839699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5bf8a7432c47fea4290732a83d3999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:50Z,use_quota=True,user_id='b194404c1de44a09ac3bcf5430ac46e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16df033-442b-48db-b5c9-484f0313290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16df033-442b-48db-b5c9-484f0313290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8fef5e-8a7c-41ae-906e-9a53ba485f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8fef5e-8a7c-41ae-906e-9a53ba485f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d', 'volume_name': 'volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243c818e-8145-4375-accb-255d7831ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243c818e-8145-4375-accb-255d7831ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d725ba-70b6-49e6-9d8a-7a2e601622d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:50 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Volume f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d', 'volume_size': 1} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:50 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741" returned: 0 in 0.300s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1595839699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5bf8a7432c47fea4290732a83d3999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:50Z,use_quota=True,user_id='b194404c1de44a09ac3bcf5430ac46e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Creating volume f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:54:50 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8afab9-d46b-4a0e-a2a2-6615fd54fa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a124dc95-811e-4dda-bc6b-6a40b8c08741', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:50 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d 1073741824 Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72b02f3-1606-41ab-a3f6-7161155d2eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:50 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:50 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Volume volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 (a124dc95-811e-4dda-bc6b-6a40b8c08741): created successfully Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72b02f3-1606-41ab-a3f6-7161155d2eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (59ad26bb-82d5-4e40-9860-89bc1fd72de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b42d2e41-b75e-453c-9d8d-84fa2b5ee113 tempest-VolumesActionsTest-939408965 None] Created volume successfully. Sep 05 20:54:50 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811" returned: 0 in 0.490s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6850971e-297d-4a9e-b657-53449f131227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa52f4f-a682-4535-8690-ad9938a500e6]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:50 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 Sep 05 20:54:50 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:50 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d 1073741824" returned: 0 in 0.425s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:50 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d Sep 05 20:54:50 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:50 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227" returned: 0 in 0.393s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:50 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 Sep 05 20:54:50 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:51 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d" returned: 0 in 0.289s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d725ba-70b6-49e6-9d8a-7a2e601622d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1339adab-bef7-4daf-becd-d5b7a716b274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:51 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Volume volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d (f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d): created successfully Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1339adab-bef7-4daf-becd-d5b7a716b274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Flow 'volume_create_manager' (ed64a1ba-08f0-4c6a-b709-5bfc4d2ab040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a251317c-f7a6-4e00-a10c-0cc8e0983b03 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Created volume successfully. Sep 05 20:54:51 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811" returned: 0 in 0.388s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:51 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811 Sep 05 20:54:51 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-a124dc95-811e-4dda-bc6b-6a40b8c08741-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Lock "cinder-a124dc95-811e-4dda-bc6b-6a40b8c08741-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-quobyte-a124dc95-811e-4dda-bc6b-6a40b8c08741" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Lock "cinder-quobyte-a124dc95-811e-4dda-bc6b-6a40b8c08741" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7b4add-3d40-461c-8ac4-feaf81abdfb6]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:51 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227.69e0c386-8e75-4b8d-99ff-4ada4ac08811" returned: 0 in 0.321s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-69e0c386-8e75-4b8d-99ff-4ada4ac08811" released by "_delete_snapshot" :: held 1.725s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" released by "delete_snapshot" :: held 1.759s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:51 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 Sep 05 20:54:51 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Created reservations ['b6fd4709-0583-48a6-9a03-20da334eab85', 'ceb32dde-e803-4526-843a-175efe9ce593', '6f89f7a1-0d9b-4021-a091-fd24968e22a4', 'e6e4dce1-34c6-4447-a378-303cff817eaf'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Delete snapshot completed successfully. Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-69e0c386-8e75-4b8d-99ff-4ada4ac08811-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Snapshots deleted, issuing volume delete {{(pid=87802) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac00f173-dc61-4a5a-b117-aac4ae6fc2e2]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:51 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 Sep 05 20:54:51 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741" returned: 0 in 0.459s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:52 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741 Sep 05 20:54:52 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227" returned: 0 in 0.412s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:52 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227 Sep 05 20:54:52 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Acquiring lock "cinder-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "cinder-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:52 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a124dc95-811e-4dda-bc6b-6a40b8c08741" returned: 0 in 0.342s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Acquiring lock "cinder-quobyte-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Lock "cinder-quobyte-a124dc95-811e-4dda-bc6b-6a40b8c08741" released by "delete_volume" :: held 0.848s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "cinder-quobyte-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[46944fc0-8689-4337-a481-078b19e798e8]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Created reservations ['a6093748-670f-40af-9b08-bef00927e4da', 'de8a8831-3f44-494d-ab13-1a8bb1c96d06', 'e3ff55e1-7c65-41a5-9bb1-271f61b91231', '8b967c41-b672-4316-9055-07f74467eb74'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:52 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6850971e-297d-4a9e-b657-53449f131227" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:52 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d Sep 05 20:54:52 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-6850971e-297d-4a9e-b657-53449f131227" released by "delete_volume" :: held 0.795s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:52 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:54:52 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Created reservations ['821cb4fa-2494-4e08-ba0b-ab0b175b9588', 'f87a0f2b-30ed-4ad9-a218-589bb1b23a65', '86444570-3595-42f9-802f-bcf273378182', '23ae827c-757a-4e04-b4d7-8ec272ecc69e'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:52 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:54:52 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d" returned: 0 in 0.465s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:52 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d Sep 05 20:54:52 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.331s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Deleted volume successfully. Sep 05 20:54:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3dbfee2b-e1c2-4121-8fe2-8a7fd1d174be tempest-VolumesActionsTest-1139223140 None] Lock "cinder-a124dc95-811e-4dda-bc6b-6a40b8c08741-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:53 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.313s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Deleted volume successfully. Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c61ca33a-f115-4efb-bb53-32f75231fe8a tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-6850971e-297d-4a9e-b657-53449f131227-delete_volume" released by "delete_volume" :: held 5.744s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:53 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "cinder-quobyte-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d" released by "delete_volume" :: held 0.815s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Created reservations ['92965f3d-4016-4954-af81-2e7b1320dfe4', '3f81f59d-a15a-4fcf-ae2b-9d84b7c56c72', 'ee0eb88e-3d12-411c-b82e-2fb7e643c750', 'e4009f2f-9300-42ea-8c3d-2294a830b9fe'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:53 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:54:53 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (ea73fc4a-bec6-48ba-8a7c-9ea17be9f8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4284a560-e215-4c3b-863d-9644cf213606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4284a560-e215-4c3b-863d-9644cf213606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809113059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:53Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b55b0a-b334-47e0-99d0-05fe4928090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b55b0a-b334-47e0-99d0-05fe4928090e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f22382-76a8-41a2-8e62-f47c93bf786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f22382-76a8-41a2-8e62-f47c93bf786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf', 'volume_name': 'volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46ef251-6edf-40b9-8c8e-411f3196c9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46ef251-6edf-40b9-8c8e-411f3196c9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b05a254-4d3c-4aa4-8843-bf30143c42ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:53 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Volume 58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf', 'volume_size': 1} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809113059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:53Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Creating volume 58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:54:53 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:53 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf 1073741824 Sep 05 20:54:53 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:53 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.389s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Deleted volume successfully. Sep 05 20:54:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-84e9eb3e-4e0e-4e69-9fd9-a645db313024 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "cinder-f976311a-8b3c-4fb4-8aad-dd2ebe94bc2d-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:54 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf 1073741824" returned: 0 in 0.564s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:54 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf Sep 05 20:54:54 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Flow 'volume_create_manager' (fb65b36f-796a-4b7b-9377-0f0e23892feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3325a337-f55d-47d3-9f91-6e6cd3989264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3325a337-f55d-47d3-9f91-6e6cd3989264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-105055831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5bf8a7432c47fea4290732a83d3999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:54Z,use_quota=True,user_id='b194404c1de44a09ac3bcf5430ac46e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d16cc50-4c28-4edd-9d43-d6474a2d104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d16cc50-4c28-4edd-9d43-d6474a2d104a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d039ca08-4f67-478d-87ce-8a9ed2615257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d039ca08-4f67-478d-87ce-8a9ed2615257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b', 'volume_name': 'volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745c92e6-79b3-4d51-a894-981ae92c6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745c92e6-79b3-4d51-a894-981ae92c6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4dd739-f65d-460e-8b70-8deb02a89626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Volume 468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b', 'volume_size': 1} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Flow 'volume_create_manager' (f8ad69f6-18db-4956-8c60-506323e13707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0cdfd5-9e29-4546-ba87-775162d7cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0cdfd5-9e29-4546-ba87-775162d7cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1129727117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf819f1f-6814-46a0-b34a-5c9b8bb45208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116d10e08da047c7a064a74a09b4a6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:54Z,use_quota=True,user_id='60c222fb6f81466e9bac7a21e315f56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5bee3c-280c-4eb6-a120-304801e77600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5bee3c-280c-4eb6-a120-304801e77600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9b4acf-a2cd-4856-8d9c-ab85d85a78b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9b4acf-a2cd-4856-8d9c-ab85d85a78b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf819f1f-6814-46a0-b34a-5c9b8bb45208', 'volume_name': 'volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068c302c-3cf2-42f0-b980-7c144fb2ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068c302c-3cf2-42f0-b980-7c144fb2ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9c7057-8430-4008-a0ec-e95750e19385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Volume bf819f1f-6814-46a0-b34a-5c9b8bb45208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208', 'volume_size': 1} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf" returned: 0 in 0.297s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-105055831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5bf8a7432c47fea4290732a83d3999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:54Z,use_quota=True,user_id='b194404c1de44a09ac3bcf5430ac46e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Creating volume 468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:54:54 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b05a254-4d3c-4aa4-8843-bf30143c42ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d190f33-af7e-4327-b69e-f0a01b37e278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:54 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b 1073741824 Sep 05 20:54:54 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Volume volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf (58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf): created successfully Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d190f33-af7e-4327-b69e-f0a01b37e278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (ea73fc4a-bec6-48ba-8a7c-9ea17be9f8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:54 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7a0b354f-0df2-4b98-b039-e581f3fb6e60 tempest-VolumesActionsTest-939408965 None] Created volume successfully. Sep 05 20:54:54 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b 1073741824" returned: 0 in 0.411s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:54 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b Sep 05 20:54:54 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:55 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b" returned: 0 in 0.245s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1129727117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf819f1f-6814-46a0-b34a-5c9b8bb45208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116d10e08da047c7a064a74a09b4a6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:54Z,use_quota=True,user_id='60c222fb6f81466e9bac7a21e315f56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Creating volume bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:54:55 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4dd739-f65d-460e-8b70-8deb02a89626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:55 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 1073741824 Sep 05 20:54:55 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f334da6-13d9-40e8-a26f-7bb96670b2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:55 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Volume volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b (468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b): created successfully Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f334da6-13d9-40e8-a26f-7bb96670b2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Flow 'volume_create_manager' (fb65b36f-796a-4b7b-9377-0f0e23892feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-cc9ec666-99c4-4f11-ae25-6710736d82f9 tempest-VolumeQuotasAdminTestJSON-2050700085 None] Created volume successfully. Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:55 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:54:55 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-quobyte-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-quobyte-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf" acquired by "delete_volume" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:55 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 1073741824" returned: 0 in 0.584s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb0d36-5010-49bf-8e7e-a536974b535b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:55 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 Sep 05 20:54:55 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:55 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:54:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:54:55 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf Sep 05 20:54:55 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:56 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208" returned: 0 in 0.364s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9c7057-8430-4008-a0ec-e95750e19385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327b1445-d7db-4644-b733-2b9255d0841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:56 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Volume volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 (bf819f1f-6814-46a0-b34a-5c9b8bb45208): created successfully Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327b1445-d7db-4644-b733-2b9255d0841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Flow 'volume_create_manager' (f8ad69f6-18db-4956-8c60-506323e13707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-467e09e2-a3f9-4ff3-b6ad-c596e578f9d7 tempest-VolumesDeleteCascade-34136379 None] Created volume successfully. Sep 05 20:54:56 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf" returned: 0 in 0.532s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:56 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf Sep 05 20:54:56 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:56 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf" returned: 0 in 0.338s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-quobyte-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf" released by "delete_volume" :: held 0.950s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Created reservations ['db9cae6e-dbad-43c9-8adf-40408b2ecac5', 'cd90d532-d0b5-4037-9857-f005427ba16d', '94cca6b6-8ea6-462f-9a89-378fddf28a73', '6bfac4fd-0108-4f61-b261-817cca1bab68'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:56 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:54:56 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2e9243b9-f82c-43bb-984e-3f0287df6f3c tempest-VolumeQuotasAdminTestJSON-534018730 None] Transfer volume completed successfully. Sep 05 20:54:57 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.292s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Deleted volume successfully. Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a30fadd6-2529-46a3-b463-c9b152a39967 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-58cd655d-eda6-42c2-a3b8-9d4ab3cd23cf-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Creating offline snapshot ec8de399-69ea-403e-97b8-5bd6c43b98c2 of volume bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabbd52f-76ca-43b4-920e-45039c125612]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:57 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 Sep 05 20:54:57 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Acquiring lock "cinder-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Lock "cinder-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Acquiring lock "cinder-quobyte-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Lock "cinder-quobyte-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f632cb-9b7b-4c15-852e-8f26573addcd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:58 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208" returned: 0 in 0.467s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:58 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 1G Sep 05 20:54:58 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:58 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b Sep 05 20:54:58 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:58 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b" returned: 0 in 0.484s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:58 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b Sep 05 20:54:58 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (0861547e-0a42-434d-a0ef-b0ee8f0e97c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755605e7-b84a-4e3b-9fad-83686531d9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:58 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755605e7-b84a-4e3b-9fad-83686531d9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-579722800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a23a41c-f37d-4351-83af-a707f365f8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:59Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba90e74-0048-4dd6-b200-4353f5f9e0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba90e74-0048-4dd6-b200-4353f5f9e0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88fae66-8720-453c-95fd-db31e1044bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88fae66-8720-453c-95fd-db31e1044bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a23a41c-f37d-4351-83af-a707f365f8ba', 'volume_name': 'volume-7a23a41c-f37d-4351-83af-a707f365f8ba', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056851f8-4b82-47a7-8fda-7dbe6d96afd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056851f8-4b82-47a7-8fda-7dbe6d96afd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cb8fa6-24ed-4276-a82c-2a0d8e1400ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:58 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Volume 7a23a41c-f37d-4351-83af-a707f365f8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a23a41c-f37d-4351-83af-a707f365f8ba', 'volume_size': 1} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 1G" returned: 0 in 0.587s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:58 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 Sep 05 20:54:58 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:58 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b" returned: 0 in 0.278s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Lock "cinder-quobyte-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b" released by "delete_volume" :: held 0.834s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Created reservations ['d1f212e6-d5ff-44dd-a0f7-fa0313e14ed0', '08089dbf-078a-4559-952d-4c461728fdeb', '844f4374-54f1-44ce-9e2e-bfa57d94ce17', '7b18d7df-1961-4e07-9909-afc508e047b6'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:59 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:54:59 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:59 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2" returned: 0 in 0.358s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:59 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 is being set with open permissions: ugo+rw Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:59 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 Sep 05 20:54:59 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:59 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.313s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Deleted volume successfully. Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b3867abf-fc85-483d-915e-95cf1ad05562 tempest-VolumeQuotasAdminTestJSON-650289095 None] Lock "cinder-468b46c5-11d2-4fcc-8cf4-5fd56f3cad9b-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:59 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:59 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.info Sep 05 20:54:59 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:59 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.info" returned: 0 in 0.320s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:59 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.info is being set with open permissions: ugo+rw Sep 05 20:54:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:59 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.info Sep 05 20:54:59 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:00 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.info" returned: 0 in 0.282s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-579722800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a23a41c-f37d-4351-83af-a707f365f8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:59Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Creating volume 7a23a41c-f37d-4351-83af-a707f365f8ba {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:00 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:00 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba 1073741824 Sep 05 20:55:00 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f6770278-ce30-4eae-b758-f33b089dacce tempest-VolumesDeleteCascade-34136379 None] Create snapshot completed successfully Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Flow 'volume_create_manager' (86a0e8fc-59c9-45dc-a373-9225fa8f6fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff6413d-4bde-4a8c-9f70-dedac74be351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff6413d-4bde-4a8c-9f70-dedac74be351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1253733610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ce12bb-7717-473f-97f4-e2863b670453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc00708160b1473c9e770d962c4a5d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:01Z,use_quota=True,user_id='68ecc35db947455aa2edd03e7b6a44e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1166a03-7785-4173-a527-5f4c12c7c90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1166a03-7785-4173-a527-5f4c12c7c90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d6a4ce-e009-4a1c-94ef-d495182ae4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d6a4ce-e009-4a1c-94ef-d495182ae4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ce12bb-7717-473f-97f4-e2863b670453', 'volume_name': 'volume-d5ce12bb-7717-473f-97f4-e2863b670453', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba4d59f-1e0b-458a-97f5-b8be6731d775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba4d59f-1e0b-458a-97f5-b8be6731d775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee9e7c9-3146-4c75-96a4-fbc2f7de0920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:00 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Volume d5ce12bb-7717-473f-97f4-e2863b670453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ce12bb-7717-473f-97f4-e2863b670453', 'volume_size': 1} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:00 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba 1073741824" returned: 0 in 0.613s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:00 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba Sep 05 20:55:00 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:01 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1253733610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ce12bb-7717-473f-97f4-e2863b670453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc00708160b1473c9e770d962c4a5d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:01Z,use_quota=True,user_id='68ecc35db947455aa2edd03e7b6a44e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Creating volume d5ce12bb-7717-473f-97f4-e2863b670453 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:01 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cb8fa6-24ed-4276-a82c-2a0d8e1400ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a23a41c-f37d-4351-83af-a707f365f8ba', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6952cb03-b5ef-42cb-8a47-858bcaaabd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:01 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 1073741824 Sep 05 20:55:01 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:01 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Volume volume-7a23a41c-f37d-4351-83af-a707f365f8ba (7a23a41c-f37d-4351-83af-a707f365f8ba): created successfully Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6952cb03-b5ef-42cb-8a47-858bcaaabd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (0861547e-0a42-434d-a0ef-b0ee8f0e97c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:01 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f60063fb-7973-495f-9c95-cb40dfa60da9 tempest-VolumesActionsTest-939408965 None] Created volume successfully. Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Flow 'volume_create_manager' (eb59d7b4-aa1e-4837-879e-1d471a810fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f69cab2-1aaa-466d-af33-4179b7a3b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f69cab2-1aaa-466d-af33-4179b7a3b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-252687701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fff1210-b9b6-4416-a1ce-6cc8892965e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116d10e08da047c7a064a74a09b4a6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec8de399-69ea-403e-97b8-5bd6c43b98c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:01Z,use_quota=True,user_id='60c222fb6f81466e9bac7a21e315f56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ce54aa-f7b2-4891-9cd7-3423898e17af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ce54aa-f7b2-4891-9cd7-3423898e17af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2e4756-cf65-4492-9b56-d3bf14cb84d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2e4756-cf65-4492-9b56-d3bf14cb84d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4fff1210-b9b6-4416-a1ce-6cc8892965e0', 'volume_name': 'volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0', 'volume_size': 1, 'snapshot_id': 'ec8de399-69ea-403e-97b8-5bd6c43b98c2'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8302ddd-6db6-4d44-8556-1c3d74c8badb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8302ddd-6db6-4d44-8556-1c3d74c8badb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5c7df4-d670-47ff-97d2-ea56482d7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:01 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Volume 4fff1210-b9b6-4416-a1ce-6cc8892965e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0', 'volume_size': 1, 'snapshot_id': 'ec8de399-69ea-403e-97b8-5bd6c43b98c2'} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:01 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 1073741824" returned: 0 in 0.584s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:01 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 Sep 05 20:55:01 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-7a23a41c-f37d-4351-83af-a707f365f8ba-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:02 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453" returned: 0 in 0.278s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.421s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-ec8de399-69ea-403e-97b8-5bd6c43b98c2-4fff1210-b9b6-4416-a1ce-6cc8892965e0" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-7a23a41c-f37d-4351-83af-a707f365f8ba-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee9e7c9-3146-4c75-96a4-fbc2f7de0920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ce12bb-7717-473f-97f4-e2863b670453', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9215f2a0-10e0-4fb4-b959-4d276465fae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-ec8de399-69ea-403e-97b8-5bd6c43b98c2-4fff1210-b9b6-4416-a1ce-6cc8892965e0" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Creating volume 4fff1210-b9b6-4416-a1ce-6cc8892965e0 from snapshot ec8de399-69ea-403e-97b8-5bd6c43b98c2 {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-4fff1210-b9b6-4416-a1ce-6cc8892965e0" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-4fff1210-b9b6-4416-a1ce-6cc8892965e0" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] snapshot: ec8de399-69ea-403e-97b8-5bd6c43b98c2, volume: 4fff1210-b9b6-4416-a1ce-6cc8892965e0, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 20:55:02 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Volume volume-d5ce12bb-7717-473f-97f4-e2863b670453 (d5ce12bb-7717-473f-97f4-e2863b670453): created successfully Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9215f2a0-10e0-4fb4-b959-4d276465fae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Flow 'volume_create_manager' (86a0e8fc-59c9-45dc-a373-9225fa8f6fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-quobyte-7a23a41c-f37d-4351-83af-a707f365f8ba" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:02 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2cc2b26a-268e-40b1-80fc-594ccc5e5fb3 tempest-AttachVolumeTestJSON-265975819 None] Created volume successfully. Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-quobyte-7a23a41c-f37d-4351-83af-a707f365f8ba" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f753e8a-78b1-451b-ac58-48f45465a84b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d1d0cb-423a-4e8b-82a0-511f1b155e70]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:02 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 Sep 05 20:55:02 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:02 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba Sep 05 20:55:02 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:02 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba" returned: 0 in 0.477s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:02 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:02 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba Sep 05 20:55:02 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2" returned: 0 in 0.542s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[157552c8-16ad-452f-aabb-383a0ea98511]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:03 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 Sep 05 20:55:03 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:03 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7a23a41c-f37d-4351-83af-a707f365f8ba" returned: 0 in 0.333s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-quobyte-7a23a41c-f37d-4351-83af-a707f365f8ba" released by "delete_volume" :: held 0.873s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Created reservations ['2f0fe680-e422-4f1b-9fe5-5e11b910bab4', '0f59f369-1cc1-4e7d-8c85-7561c2aaf774', '403f0d5b-bb10-40e4-9c20-7c6bfccf8ce9', 'f9575779-5feb-4d10-bab9-7950e6c6ff1b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:03 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208" returned: 0 in 0.655s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:03 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:03 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:03 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 Sep 05 20:55:03 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:03 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.362s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Deleted volume successfully. Sep 05 20:55:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d6f36cc0-a8a7-4cc4-a135-49deb9de8569 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-7a23a41c-f37d-4351-83af-a707f365f8ba-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-19ab3486-50ba-453a-a5e7-c0f21bc0e8ae req-05f83d03-08d6-44e7-883c-67c95733146a tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (f62813e4-ce22-46a4-a881-09f684512619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d5eb2a-1e7c-4568-84b7-4b4283df7774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d5eb2a-1e7c-4568-84b7-4b4283df7774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1376919835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a5a490-195b-4b7a-8b42-2033c08f13ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:06Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee502337-f28f-492a-a511-fdf6394b5554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee502337-f28f-492a-a511-fdf6394b5554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0425df-74d7-4cdd-bd7f-9c602c02a37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0425df-74d7-4cdd-bd7f-9c602c02a37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a5a490-195b-4b7a-8b42-2033c08f13ed', 'volume_name': 'volume-24a5a490-195b-4b7a-8b42-2033c08f13ed', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33290b30-5756-401e-996f-2896d87f9b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33290b30-5756-401e-996f-2896d87f9b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c319b-4886-4962-9112-fdebf417fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:06 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Volume 24a5a490-195b-4b7a-8b42-2033c08f13ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a5a490-195b-4b7a-8b42-2033c08f13ed', 'volume_size': 1} Sep 05 20:55:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:09 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0" returned: 0 in 5.836s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:55:09 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Converted 1024.00 MB image at 175.42 MB/s Sep 05 20:55:09 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 is being set with open permissions: ugo+rw Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:09 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 Sep 05 20:55:09 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:09 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0" returned: 0 in 0.288s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-4fff1210-b9b6-4416-a1ce-6cc8892965e0" released by "_copy_volume_from_snapshot" :: held 7.496s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-ec8de399-69ea-403e-97b8-5bd6c43b98c2-4fff1210-b9b6-4416-a1ce-6cc8892965e0" released by "_create_volume_from_snapshot" :: held 7.581s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.641s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-19ab3486-50ba-453a-a5e7-c0f21bc0e8ae req-05f83d03-08d6-44e7-883c-67c95733146a tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.094s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-19ab3486-50ba-453a-a5e7-c0f21bc0e8ae req-05f83d03-08d6-44e7-883c-67c95733146a tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.913s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1376919835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a5a490-195b-4b7a-8b42-2033c08f13ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:06Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Creating volume 24a5a490-195b-4b7a-8b42-2033c08f13ed {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:09 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5c7df4-d670-47ff-97d2-ea56482d7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0', 'volume_size': 1, 'snapshot_id': 'ec8de399-69ea-403e-97b8-5bd6c43b98c2'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3651cae7-71ff-463d-b7a0-f38113d0d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:09 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed 1073741824 Sep 05 20:55:09 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:09 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Volume volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 (4fff1210-b9b6-4416-a1ce-6cc8892965e0): created successfully Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3651cae7-71ff-463d-b7a0-f38113d0d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Flow 'volume_create_manager' (eb59d7b4-aa1e-4837-879e-1d471a810fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-19ab3486-50ba-453a-a5e7-c0f21bc0e8ae req-05f83d03-08d6-44e7-883c-67c95733146a tempest-AttachVolumeTestJSON-265975819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-d5ce12bb-7717-473f-97f4-e2863b670453', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c53ade0f-b067-4e07-b4e9-b444c4731153', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:55:09 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2d43e564-1321-4aef-8923-fdd678f27c65 tempest-VolumesDeleteCascade-34136379 None] Created volume successfully. Sep 05 20:55:09 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-19ab3486-50ba-453a-a5e7-c0f21bc0e8ae req-05f83d03-08d6-44e7-883c-67c95733146a tempest-AttachVolumeTestJSON-265975819 None] attachment_update completed successfully. Sep 05 20:55:10 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed 1073741824" returned: 0 in 0.649s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:10 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed Sep 05 20:55:10 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:10 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed" returned: 0 in 0.426s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c319b-4886-4962-9112-fdebf417fced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a5a490-195b-4b7a-8b42-2033c08f13ed', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b39f4e8-af01-41f6-a953-e0562ed9bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:10 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Volume volume-24a5a490-195b-4b7a-8b42-2033c08f13ed (24a5a490-195b-4b7a-8b42-2033c08f13ed): created successfully Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b39f4e8-af01-41f6-a953-e0562ed9bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (f62813e4-ce22-46a4-a881-09f684512619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:11 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e01e107c-9432-4a39-9556-1bf118acb710 tempest-VolumesActionsTest-939408965 None] Created volume successfully. Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-bf819f1f-6814-46a0-b34a-5c9b8bb45208-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-bf819f1f-6814-46a0-b34a-5c9b8bb45208-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Performing cascade delete. {{(pid=87802) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-ec8de399-69ea-403e-97b8-5bd6c43b98c2-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-ec8de399-69ea-403e-97b8-5bd6c43b98c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-bf819f1f-6814-46a0-b34a-5c9b8bb45208" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-bf819f1f-6814-46a0-b34a-5c9b8bb45208" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-ec8de399-69ea-403e-97b8-5bd6c43b98c2" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-ec8de399-69ea-403e-97b8-5bd6c43b98c2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Deleting offline snapshot ec8de399-69ea-403e-97b8-5bd6c43b98c2 of volume bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] snapshot_file for this snap is: volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e321a4-ba9f-4074-adae-1203b2abd936]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:11 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 Sep 05 20:55:11 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:11 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2" returned: 0 in 0.437s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa2c8d5-537c-405b-a9a7-40cfb055fda4]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:11 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 Sep 05 20:55:11 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-24a5a490-195b-4b7a-8b42-2033c08f13ed-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-24a5a490-195b-4b7a-8b42-2033c08f13ed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "cinder-quobyte-24a5a490-195b-4b7a-8b42-2033c08f13ed" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-quobyte-24a5a490-195b-4b7a-8b42-2033c08f13ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:12 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208" returned: 0 in 0.814s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b2e7d-8e24-4f77-a562-2be12e680202]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:12 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 Sep 05 20:55:12 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:12 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed Sep 05 20:55:12 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:12 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2" returned: 0 in 0.402s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:13 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2 Sep 05 20:55:13 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:13 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed" returned: 0 in 0.472s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:13 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed Sep 05 20:55:13 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:13 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208.ec8de399-69ea-403e-97b8-5bd6c43b98c2" returned: 0 in 0.346s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:13 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-24a5a490-195b-4b7a-8b42-2033c08f13ed" returned: 0 in 0.300s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-ec8de399-69ea-403e-97b8-5bd6c43b98c2" released by "_delete_snapshot" :: held 2.132s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-quobyte-24a5a490-195b-4b7a-8b42-2033c08f13ed" released by "delete_volume" :: held 0.866s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-bf819f1f-6814-46a0-b34a-5c9b8bb45208" released by "delete_snapshot" :: held 2.170s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Created reservations ['42aeb070-96cb-4cca-9863-cbfa3c90e41b', '8626859a-3315-4814-bde7-38dfcc04baf8', 'dac7722a-9a7c-4cd2-add5-5bb10499848c', 'ab23ac17-0f33-447b-92b0-96241fd6c285'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Created reservations ['bf39aa95-2f38-4863-8b20-b6737cb39388', 'cc4ebd0e-bc99-4b83-988d-5c9f054aa252', 'd2b12233-5ee9-4ff9-a9a1-bea87be59ae3', '476bd7e7-9f20-4a25-80b0-41a9cadee90b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:13 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:13 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:13 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Delete snapshot completed successfully. Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-ec8de399-69ea-403e-97b8-5bd6c43b98c2-delete_snapshot" released by "delete_snapshot" :: held 2.534s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Snapshots deleted, issuing volume delete {{(pid=87802) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-bf819f1f-6814-46a0-b34a-5c9b8bb45208" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-bf819f1f-6814-46a0-b34a-5c9b8bb45208" acquired by "delete_volume" :: waited 0.040s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2702630-556b-4a18-83ae-ec522d04e9d6]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:14 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 Sep 05 20:55:14 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:14 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.633s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:14 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Deleted volume successfully. Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-232e96e1-7436-4df5-9182-cd0589a01a69 tempest-VolumesActionsTest-1139223140 None] Lock "cinder-24a5a490-195b-4b7a-8b42-2033c08f13ed-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:14 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208" returned: 0 in 0.866s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:14 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208 Sep 05 20:55:14 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (8ad329b0-ded8-40b4-be0b-0778b6108777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c867ec-c8d2-47cb-829d-a0e6f52834f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c867ec-c8d2-47cb-829d-a0e6f52834f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423600568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d376d8b-1a85-4b87-ae94-d24736690c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:15Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d90863d-7e74-4ab9-8229-71d8756ab408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d90863d-7e74-4ab9-8229-71d8756ab408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857612a5-e309-4be3-9571-95e984ed795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857612a5-e309-4be3-9571-95e984ed795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d376d8b-1a85-4b87-ae94-d24736690c53', 'volume_name': 'volume-9d376d8b-1a85-4b87-ae94-d24736690c53', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37448622-eb28-4989-b323-60d56dd5246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37448622-eb28-4989-b323-60d56dd5246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69449e87-509d-4d4f-93b0-3662fee3d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:14 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Volume 9d376d8b-1a85-4b87-ae94-d24736690c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d376d8b-1a85-4b87-ae94-d24736690c53', 'volume_size': 1} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423600568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d376d8b-1a85-4b87-ae94-d24736690c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff429d3a11642d2834532290f41e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:15Z,use_quota=True,user_id='4affefec87524336906adf018ea87062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Creating volume 9d376d8b-1a85-4b87-ae94-d24736690c53 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:14 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:14 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 1073741824 Sep 05 20:55:14 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:15 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bf819f1f-6814-46a0-b34a-5c9b8bb45208" returned: 0 in 0.384s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-bf819f1f-6814-46a0-b34a-5c9b8bb45208" released by "delete_volume" :: held 1.360s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Created reservations ['decee4ce-b9be-4571-894c-ed0585f678a6', '48f1eae0-82cd-4ba3-947d-5385df9f4027', 'b3bb811c-cb2b-45b6-9d0c-894db77c347b', '634fb24d-807c-4404-871b-2abfdbbdf0fe'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:15 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:15 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 1073741824" returned: 0 in 0.827s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:15 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=107,cinder:UPDATE=131,cinder:INSERT=34,cinder:DELETE=12 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:55:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:15 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 Sep 05 20:55:15 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:16 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.672s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Deleted volume successfully. Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9b98962a-4fe6-44a5-9c59-aa9aaa20ca43 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-bf819f1f-6814-46a0-b34a-5c9b8bb45208-delete_volume" released by "delete_volume" :: held 4.966s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-4fff1210-b9b6-4416-a1ce-6cc8892965e0-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-4fff1210-b9b6-4416-a1ce-6cc8892965e0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=134,cinder:SELECT=116,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "cinder-quobyte-4fff1210-b9b6-4416-a1ce-6cc8892965e0" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-4fff1210-b9b6-4416-a1ce-6cc8892965e0" acquired by "delete_volume" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a5d148-e241-4698-a23e-12f73a719f0a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:16 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 Sep 05 20:55:16 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:16 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53" returned: 0 in 0.751s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69449e87-509d-4d4f-93b0-3662fee3d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d376d8b-1a85-4b87-ae94-d24736690c53', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3581382-c781-4717-9c6e-bfb4346eab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:16 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Volume volume-9d376d8b-1a85-4b87-ae94-d24736690c53 (9d376d8b-1a85-4b87-ae94-d24736690c53): created successfully Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3581382-c781-4717-9c6e-bfb4346eab69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Flow 'volume_create_manager' (8ad329b0-ded8-40b4-be0b-0778b6108777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-eb119028-09ae-4180-a244-b8acba026c45 tempest-VolumesActionsTest-939408965 None] Created volume successfully. Sep 05 20:55:16 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0" returned: 0 in 0.591s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:16 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0 Sep 05 20:55:16 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:17 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4fff1210-b9b6-4416-a1ce-6cc8892965e0" returned: 0 in 0.301s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-quobyte-4fff1210-b9b6-4416-a1ce-6cc8892965e0" released by "delete_volume" :: held 0.996s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Created reservations ['bfda90fe-c898-4570-94b9-62212856b82e', 'a5128e7c-4c4f-44c4-84ea-a734b0c5f22e', '012ffc71-0e48-4478-9dda-52a0e2bcedcf', '769f7b27-897a-4289-b272-f3baf8675ba5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:17 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:17 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:18 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.526s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:18 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Deleted volume successfully. Sep 05 20:55:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a1a7bb8b-68a7-4106-bb03-19b749a3c143 tempest-VolumesDeleteCascade-34136379 None] Lock "cinder-4fff1210-b9b6-4416-a1ce-6cc8892965e0-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Acquiring lock "cinder-9d376d8b-1a85-4b87-ae94-d24736690c53-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Lock "cinder-9d376d8b-1a85-4b87-ae94-d24736690c53-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Acquiring lock "cinder-quobyte-9d376d8b-1a85-4b87-ae94-d24736690c53" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Lock "cinder-quobyte-9d376d8b-1a85-4b87-ae94-d24736690c53" acquired by "delete_volume" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:19 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[343f0b31-ca9f-440a-9b1e-478d9faa6a1c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:19 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 Sep 05 20:55:19 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:20 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53" returned: 0 in 0.610s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:20 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53 Sep 05 20:55:20 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:20 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9d376d8b-1a85-4b87-ae94-d24736690c53" returned: 0 in 0.443s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Lock "cinder-quobyte-9d376d8b-1a85-4b87-ae94-d24736690c53" released by "delete_volume" :: held 1.143s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Created reservations ['53b91b5b-ca99-49c2-b62d-2b730c75ad39', 'ab98f9aa-67e7-4665-8ed8-23754db6bab0', '78e9ee7e-8f8f-45a4-bf61-d7834e00f9f3', 'a099b7d8-be08-4335-b1ca-7d5a23e708e3'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:20 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:20 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:21 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.414s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:21 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:21 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Deleted volume successfully. Sep 05 20:55:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-b534ece3-29ab-406e-be63-4e5e9142e834 tempest-VolumesActionsTest-939408965 None] Lock "cinder-9d376d8b-1a85-4b87-ae94-d24736690c53-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Flow 'volume_create_manager' (3f64c620-cc6e-4a54-90f1-b863ba451ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4239ac4b-1591-4111-abc9-68d0b5d47eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4239ac4b-1591-4111-abc9-68d0b5d47eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-624903823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd502f5b-a10c-49ef-95d3-4453141c17bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e737e24b954c1e9f3efe869827efe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:25Z,use_quota=True,user_id='24a6d63169334bf6b325762e2e2f5e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10cc3ea5-7053-41f1-ab7b-5ce12dfd9223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10cc3ea5-7053-41f1-ab7b-5ce12dfd9223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baad0c3d-3007-40bf-96f1-b9c946f1422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baad0c3d-3007-40bf-96f1-b9c946f1422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd502f5b-a10c-49ef-95d3-4453141c17bb', 'volume_name': 'volume-bd502f5b-a10c-49ef-95d3-4453141c17bb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfc0f02-3cfe-414c-8e6c-9ab61a2f8c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfc0f02-3cfe-414c-8e6c-9ab61a2f8c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d0fb30-2fd1-4d87-9217-c8c36acba24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:25 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Volume bd502f5b-a10c-49ef-95d3-4453141c17bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd502f5b-a10c-49ef-95d3-4453141c17bb', 'volume_size': 1} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-624903823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd502f5b-a10c-49ef-95d3-4453141c17bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e737e24b954c1e9f3efe869827efe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:25Z,use_quota=True,user_id='24a6d63169334bf6b325762e2e2f5e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Creating volume bd502f5b-a10c-49ef-95d3-4453141c17bb {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:25 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:25 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb 1073741824 Sep 05 20:55:25 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:26 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb 1073741824" returned: 0 in 0.636s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:26 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb Sep 05 20:55:26 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:26 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb" returned: 0 in 0.311s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d0fb30-2fd1-4d87-9217-c8c36acba24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd502f5b-a10c-49ef-95d3-4453141c17bb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad624333-0a98-4210-9574-b5b41c99991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:26 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Volume volume-bd502f5b-a10c-49ef-95d3-4453141c17bb (bd502f5b-a10c-49ef-95d3-4453141c17bb): created successfully Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad624333-0a98-4210-9574-b5b41c99991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Flow 'volume_create_manager' (3f64c620-cc6e-4a54-90f1-b863ba451ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-664a72b6-3f3f-43e5-92dd-d677c3d9eca7 tempest-VolumesMetadataTest-1654366119 None] Created volume successfully. Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Acquiring lock "cinder-bd502f5b-a10c-49ef-95d3-4453141c17bb-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Lock "cinder-bd502f5b-a10c-49ef-95d3-4453141c17bb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Acquiring lock "cinder-quobyte-bd502f5b-a10c-49ef-95d3-4453141c17bb" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Lock "cinder-quobyte-bd502f5b-a10c-49ef-95d3-4453141c17bb" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7925b5b5-222d-4dbb-a965-f34fdf700566]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Flow 'volume_create_manager' (373fa3c7-d610-4cc9-b085-4bc7c735a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61544ed-9664-41a5-87ec-c30d64f86fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:29 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb Sep 05 20:55:29 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61544ed-9664-41a5-87ec-c30d64f86fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1630949775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d562b925-616a-4858-a2ba-57adfe1f5ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9db70dd9a04ba6940363ad4d5a4b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:29Z,use_quota=True,user_id='b18379097c2c45f8a1db73e91d1ed514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b414a342-52f5-45fd-81e0-877c479870e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b414a342-52f5-45fd-81e0-877c479870e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb41ddf7-2331-456a-b574-8b4f644639e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb41ddf7-2331-456a-b574-8b4f644639e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd562b925-616a-4858-a2ba-57adfe1f5ebf', 'volume_name': 'volume-d562b925-616a-4858-a2ba-57adfe1f5ebf', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298aefab-2aca-413c-8552-95fbbf50032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298aefab-2aca-413c-8552-95fbbf50032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238f5de7-f503-4440-b8df-aa7ad36ea3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:29 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Volume d562b925-616a-4858-a2ba-57adfe1f5ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d562b925-616a-4858-a2ba-57adfe1f5ebf', 'volume_size': 1} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1630949775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d562b925-616a-4858-a2ba-57adfe1f5ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9db70dd9a04ba6940363ad4d5a4b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:29Z,use_quota=True,user_id='b18379097c2c45f8a1db73e91d1ed514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Creating volume d562b925-616a-4858-a2ba-57adfe1f5ebf {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:29 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:29 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf 1073741824 Sep 05 20:55:29 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:30 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb" returned: 0 in 0.491s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:30 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb Sep 05 20:55:30 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:30 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf 1073741824" returned: 0 in 0.701s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:30 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bd502f5b-a10c-49ef-95d3-4453141c17bb" returned: 0 in 0.570s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:30 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf Sep 05 20:55:30 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Lock "cinder-quobyte-bd502f5b-a10c-49ef-95d3-4453141c17bb" released by "delete_volume" :: held 1.150s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Created reservations ['644b481b-8cc3-4752-903a-84aac68323f4', '9e7b6770-8ce4-4eb3-a747-6197e7d07fda', '14b07d30-f5b1-455d-8cda-e12f0578e608', 'f82f372c-5e45-45ee-83ca-f3eaa752b543'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:30 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf" returned: 0 in 0.375s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238f5de7-f503-4440-b8df-aa7ad36ea3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d562b925-616a-4858-a2ba-57adfe1f5ebf', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42954264-3c74-4d92-9ba5-ee5d68f1b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:30 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Volume volume-d562b925-616a-4858-a2ba-57adfe1f5ebf (d562b925-616a-4858-a2ba-57adfe1f5ebf): created successfully Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42954264-3c74-4d92-9ba5-ee5d68f1b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Flow 'volume_create_manager' (373fa3c7-d610-4cc9-b085-4bc7c735a953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:30 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:30 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-48eec37a-074d-44ce-a455-6be51c0f377d tempest-SnapshotMetadataTestJSON-17404590 None] Created volume successfully. Sep 05 20:55:31 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.276s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:31 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:31 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Deleted volume successfully. Sep 05 20:55:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-53b830e9-1fe7-4103-bb3e-5a8633b85a5e tempest-VolumesMetadataTest-1654366119 None] Lock "cinder-bd502f5b-a10c-49ef-95d3-4453141c17bb-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Creating offline snapshot 569be9f3-f581-48df-af5b-85dec0bbe9c8 of volume d562b925-616a-4858-a2ba-57adfe1f5ebf {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:55:32 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a14206a-4358-4b3a-9e34-f683cba84f69]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:32 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf Sep 05 20:55:32 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:32 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf" returned: 0 in 0.557s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:32 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 1G Sep 05 20:55:32 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:33 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 1G" returned: 0 in 0.618s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d562b925-616a-4858-a2ba-57adfe1f5ebf -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:33 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d562b925-616a-4858-a2ba-57adfe1f5ebf -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 Sep 05 20:55:33 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:33 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d562b925-616a-4858-a2ba-57adfe1f5ebf -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8" returned: 0 in 0.477s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:33 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 is being set with open permissions: ugo+rw Sep 05 20:55:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:33 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 Sep 05 20:55:33 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:34 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8" returned: 0 in 0.351s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:34 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.info Sep 05 20:55:34 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:34 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.info" returned: 0 in 0.387s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:34 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.info is being set with open permissions: ugo+rw Sep 05 20:55:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:34 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.info Sep 05 20:55:34 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:34 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.info" returned: 0 in 0.331s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:34 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-930c7a61-4fb3-4a77-b597-2ac6db38e6c4 tempest-SnapshotMetadataTestJSON-17404590 None] Create snapshot completed successfully Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "cinder-569be9f3-f581-48df-af5b-85dec0bbe9c8-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-569be9f3-f581-48df-af5b-85dec0bbe9c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "cinder-quobyte-d562b925-616a-4858-a2ba-57adfe1f5ebf" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-quobyte-d562b925-616a-4858-a2ba-57adfe1f5ebf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "cinder-quobyte-569be9f3-f581-48df-af5b-85dec0bbe9c8" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-quobyte-569be9f3-f581-48df-af5b-85dec0bbe9c8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Deleting offline snapshot 569be9f3-f581-48df-af5b-85dec0bbe9c8 of volume d562b925-616a-4858-a2ba-57adfe1f5ebf {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] snapshot_file for this snap is: volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c940c1-7fba-41e1-8db4-b174b546ce84]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:36 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 Sep 05 20:55:36 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:36 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8" returned: 0 in 0.451s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d562b925-616a-4858-a2ba-57adfe1f5ebf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3b3bd9-5286-4347-b13d-526e05805350]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:37 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf Sep 05 20:55:37 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:37 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf" returned: 0 in 0.422s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:37 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 Sep 05 20:55:37 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:37 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8" returned: 0 in 0.438s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:37 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8 Sep 05 20:55:37 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:38 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf.569be9f3-f581-48df-af5b-85dec0bbe9c8" returned: 0 in 0.280s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-quobyte-569be9f3-f581-48df-af5b-85dec0bbe9c8" released by "_delete_snapshot" :: held 1.767s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-quobyte-d562b925-616a-4858-a2ba-57adfe1f5ebf" released by "delete_snapshot" :: held 1.794s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Created reservations ['c9c4685a-e1ce-4b78-8c85-8b53a4779d81', '7cea6a44-2d02-4e27-b4c6-f25b94b1101a', '2a37ff5f-33a3-481e-a46b-8c26eb87a384', '81bb31e9-fc40-47f2-b158-f25d02db7e88'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Delete snapshot completed successfully. Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75514b3c-f1d8-4204-9a07-8ca5467d3357 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-569be9f3-f581-48df-af5b-85dec0bbe9c8-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "cinder-d562b925-616a-4858-a2ba-57adfe1f5ebf-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-d562b925-616a-4858-a2ba-57adfe1f5ebf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "cinder-quobyte-d562b925-616a-4858-a2ba-57adfe1f5ebf" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-quobyte-d562b925-616a-4858-a2ba-57adfe1f5ebf" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c1864-5e2e-4179-a1f7-195f925e9235]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Flow 'volume_create_manager' (738f9a39-583a-4f5a-926a-f8e3f4ccc020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764431d9-4252-440b-ad2c-fa765e049321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764431d9-4252-440b-ad2c-fa765e049321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1670744404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b3fa0e-82fd-486e-85ee-34f891322dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebd782b4d74de2b50d69e6c10de93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:39Z,use_quota=True,user_id='d928948da14b4bfa8ae7cf60664f7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c17c76-ea48-4fd9-896d-0485a3ee7971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c17c76-ea48-4fd9-896d-0485a3ee7971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfab927d-6eb9-4aee-912f-ca1b58d45d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfab927d-6eb9-4aee-912f-ca1b58d45d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b3fa0e-82fd-486e-85ee-34f891322dcf', 'volume_name': 'volume-66b3fa0e-82fd-486e-85ee-34f891322dcf', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49434cd-e1b1-4983-87db-27ea973daadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49434cd-e1b1-4983-87db-27ea973daadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:38 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf Sep 05 20:55:38 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06fa000-b41f-4987-b0cb-4c046f81c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:38 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Volume 66b3fa0e-82fd-486e-85ee-34f891322dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b3fa0e-82fd-486e-85ee-34f891322dcf', 'volume_size': 1} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1670744404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b3fa0e-82fd-486e-85ee-34f891322dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebd782b4d74de2b50d69e6c10de93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:39Z,use_quota=True,user_id='d928948da14b4bfa8ae7cf60664f7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Creating volume 66b3fa0e-82fd-486e-85ee-34f891322dcf {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:38 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:38 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf 1073741824 Sep 05 20:55:38 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:39 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf" returned: 0 in 0.405s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:39 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf Sep 05 20:55:39 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:39 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf 1073741824" returned: 0 in 0.512s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:39 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d562b925-616a-4858-a2ba-57adfe1f5ebf" returned: 0 in 0.287s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:39 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf Sep 05 20:55:39 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-quobyte-d562b925-616a-4858-a2ba-57adfe1f5ebf" released by "delete_volume" :: held 0.761s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Created reservations ['2a37b911-2a1b-4612-9d68-990a0d1f0ec6', '4f98c88b-5bcc-4ccb-8295-7f4bd4c312de', 'c3934e49-ded9-42a2-bdb3-30db32592864', '0a420f9e-5326-4dab-a4df-ea8939c4c5e1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:39 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:39 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:39 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf" returned: 0 in 0.308s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06fa000-b41f-4987-b0cb-4c046f81c488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b3fa0e-82fd-486e-85ee-34f891322dcf', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271cf553-919d-448b-9fc6-b323a423b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:39 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Volume volume-66b3fa0e-82fd-486e-85ee-34f891322dcf (66b3fa0e-82fd-486e-85ee-34f891322dcf): created successfully Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271cf553-919d-448b-9fc6-b323a423b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Flow 'volume_create_manager' (738f9a39-583a-4f5a-926a-f8e3f4ccc020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-79519267-1e87-4671-8ef7-287e429a70fd tempest-VolumesTransfersTest-178316312 None] Created volume successfully. Sep 05 20:55:39 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.278s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:39 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Deleted volume successfully. Sep 05 20:55:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5040e918-1237-4665-be37-8318cdd4dc20 tempest-SnapshotMetadataTestJSON-17404590 None] Lock "cinder-d562b925-616a-4858-a2ba-57adfe1f5ebf-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Flow 'volume_create_manager' (7c3f889e-6769-46f2-8ec2-7d9b586f69e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9da9ba-d50e-4456-bcd6-7f544e8a93b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9da9ba-d50e-4456-bcd6-7f544e8a93b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-675219514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5317125ddc478f806f4dcbbb9bfdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:42Z,use_quota=True,user_id='3536a1430cb448a7859fc3febda84243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040590c8-3d4f-4734-8277-1778dc36f7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040590c8-3d4f-4734-8277-1778dc36f7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97ea51c-cfe5-42dc-a4b7-7b28edad8608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97ea51c-cfe5-42dc-a4b7-7b28edad8608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d', 'volume_name': 'volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbb8119-80d3-4e31-a6d8-7ae1d7c2301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbb8119-80d3-4e31-a6d8-7ae1d7c2301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e80c88-50b5-4784-944c-82242a50abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Volume f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d', 'volume_size': 1} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-675219514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5317125ddc478f806f4dcbbb9bfdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:42Z,use_quota=True,user_id='3536a1430cb448a7859fc3febda84243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Creating volume f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:41 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:41 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d 1073741824 Sep 05 20:55:41 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a9c00ee8-0446-426d-932e-a406fc9aea62 tempest-VolumesTransfersTest-785565972 None] Transfer volume completed successfully. Sep 05 20:55:42 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d 1073741824" returned: 0 in 0.610s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:42 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d Sep 05 20:55:42 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:42 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d" returned: 0 in 0.325s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e80c88-50b5-4784-944c-82242a50abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3c6170-b051-40ff-a472-0a206bedb425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:42 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Volume volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d (f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d): created successfully Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3c6170-b051-40ff-a472-0a206bedb425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Flow 'volume_create_manager' (7c3f889e-6769-46f2-8ec2-7d9b586f69e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fd5cbd50-b2aa-476d-b507-b057d5b9109f tempest-VolumesListAdminTestJSON-172871894 None] Created volume successfully. Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Acquiring lock "cinder-66b3fa0e-82fd-486e-85ee-34f891322dcf-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Lock "cinder-66b3fa0e-82fd-486e-85ee-34f891322dcf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Acquiring lock "cinder-quobyte-66b3fa0e-82fd-486e-85ee-34f891322dcf" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Lock "cinder-quobyte-66b3fa0e-82fd-486e-85ee-34f891322dcf" acquired by "delete_volume" :: waited 0.013s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[790e6dcf-dbfb-4a19-9953-8faf392c36dd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:43 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf Sep 05 20:55:43 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:43 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:43 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf Sep 05 20:55:43 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:43 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-66b3fa0e-82fd-486e-85ee-34f891322dcf" returned: 0 in 0.278s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Lock "cinder-quobyte-66b3fa0e-82fd-486e-85ee-34f891322dcf" released by "delete_volume" :: held 0.700s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Created reservations ['a885dbf6-21ee-4f0b-b53c-8fdc6303867d', '223aeae9-8756-4eec-80f7-8e0e77858a0d', 'c72fa602-7fab-4272-bf57-4d6ff04dfc59', '7b39e64b-66ce-4130-a0ee-b68570206558'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:44 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:44 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:44 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.350s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Flow 'volume_create_manager' (b30d0c6b-c6c8-499b-8fd5-a8a58873f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c783d2-9906-4916-a7db-a524f26ed9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Deleted volume successfully. Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c783d2-9906-4916-a7db-a524f26ed9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-132450103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f800488-99e7-4cf8-aa86-3c5468f56a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5317125ddc478f806f4dcbbb9bfdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:44Z,use_quota=True,user_id='3536a1430cb448a7859fc3febda84243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac20396-6ecd-44ac-b6a5-5128290e19af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac20396-6ecd-44ac-b6a5-5128290e19af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bf5167-7e4b-421c-8b0b-2e22e59b977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bf5167-7e4b-421c-8b0b-2e22e59b977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f800488-99e7-4cf8-aa86-3c5468f56a5f', 'volume_name': 'volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e7e8fd-365e-46b6-86e5-feb7d5cbcbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e7e8fd-365e-46b6-86e5-feb7d5cbcbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d386b2-97fa-4970-b021-2a266ca80c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Volume 5f800488-99e7-4cf8-aa86-3c5468f56a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f', 'volume_size': 1} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-132450103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f800488-99e7-4cf8-aa86-3c5468f56a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5317125ddc478f806f4dcbbb9bfdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:44Z,use_quota=True,user_id='3536a1430cb448a7859fc3febda84243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Creating volume 5f800488-99e7-4cf8-aa86-3c5468f56a5f {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:44 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0f963773-5286-48b7-8c6e-d5078a1bd0ae tempest-VolumesTransfersTest-1855397767 None] Lock "cinder-66b3fa0e-82fd-486e-85ee-34f891322dcf-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:44 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f 1073741824 Sep 05 20:55:44 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Flow 'volume_create_manager' (935acbc4-35c5-44ab-a9ed-8a2ef286faec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1297899-26c1-455d-8b26-1f0619c0e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1297899-26c1-455d-8b26-1f0619c0e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-723716060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca3c236-3639-419c-b99d-00e8dced7825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebd782b4d74de2b50d69e6c10de93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:45Z,use_quota=True,user_id='d928948da14b4bfa8ae7cf60664f7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019a4c16-7aad-454c-b6f7-904d9fd2dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019a4c16-7aad-454c-b6f7-904d9fd2dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036f0fcb-7b59-4a0a-bf50-3fdb2f7e8f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036f0fcb-7b59-4a0a-bf50-3fdb2f7e8f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca3c236-3639-419c-b99d-00e8dced7825', 'volume_name': 'volume-9ca3c236-3639-419c-b99d-00e8dced7825', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd209d8-b28c-46ad-8975-f66561c4398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd209d8-b28c-46ad-8975-f66561c4398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ab22f0-7ae6-479a-b033-8748a8e49a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:44 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Volume 9ca3c236-3639-419c-b99d-00e8dced7825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca3c236-3639-419c-b99d-00e8dced7825', 'volume_size': 1} Sep 05 20:55:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:45 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f 1073741824" returned: 0 in 0.542s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:45 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f Sep 05 20:55:45 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:45 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f" returned: 0 in 0.273s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-723716060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca3c236-3639-419c-b99d-00e8dced7825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebd782b4d74de2b50d69e6c10de93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:45Z,use_quota=True,user_id='d928948da14b4bfa8ae7cf60664f7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Creating volume 9ca3c236-3639-419c-b99d-00e8dced7825 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:45 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d386b2-97fa-4970-b021-2a266ca80c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:45 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 1073741824 Sep 05 20:55:45 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7336db-09a2-4aea-86ab-16747c8d2cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:45 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Volume volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f (5f800488-99e7-4cf8-aa86-3c5468f56a5f): created successfully Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7336db-09a2-4aea-86ab-16747c8d2cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Flow 'volume_create_manager' (b30d0c6b-c6c8-499b-8fd5-a8a58873f851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6dfc637c-15e7-4de8-a8f6-4ed3678a5ed7 tempest-VolumesListAdminTestJSON-172871894 None] Created volume successfully. Sep 05 20:55:45 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 1073741824" returned: 0 in 0.512s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:45 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 Sep 05 20:55:45 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:46 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ab22f0-7ae6-479a-b033-8748a8e49a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca3c236-3639-419c-b99d-00e8dced7825', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7e8a74-2f0a-4ae8-a837-bf51003486b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:46 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Volume volume-9ca3c236-3639-419c-b99d-00e8dced7825 (9ca3c236-3639-419c-b99d-00e8dced7825): created successfully Sep 05 20:55:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7e8a74-2f0a-4ae8-a837-bf51003486b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Flow 'volume_create_manager' (935acbc4-35c5-44ab-a9ed-8a2ef286faec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:46 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-72be30fe-06e8-4417-8c02-4d40828f25fc tempest-VolumesTransfersTest-178316312 None] Created volume successfully. Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Flow 'volume_create_manager' (2032a227-239e-48b0-820c-1989443de3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f090ece-dcc0-49a3-bbe2-cd2ed6c6ae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f090ece-dcc0-49a3-bbe2-cd2ed6c6ae4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1082442854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a848ae-ab42-4546-81b8-bcc059e177b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5317125ddc478f806f4dcbbb9bfdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:47Z,use_quota=True,user_id='3536a1430cb448a7859fc3febda84243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7f43ba-7c40-441c-a006-08daeba64279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7f43ba-7c40-441c-a006-08daeba64279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1127eaf-8e16-41ba-8c1f-f868dde649a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1127eaf-8e16-41ba-8c1f-f868dde649a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a848ae-ab42-4546-81b8-bcc059e177b6', 'volume_name': 'volume-a8a848ae-ab42-4546-81b8-bcc059e177b6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc67155b-bffa-457b-b726-2c57b0d14da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc67155b-bffa-457b-b726-2c57b0d14da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58851102-512d-4f7f-afee-398544ab089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:47 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Volume a8a848ae-ab42-4546-81b8-bcc059e177b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a848ae-ab42-4546-81b8-bcc059e177b6', 'volume_size': 1} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1082442854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a848ae-ab42-4546-81b8-bcc059e177b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5317125ddc478f806f4dcbbb9bfdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:47Z,use_quota=True,user_id='3536a1430cb448a7859fc3febda84243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Creating volume a8a848ae-ab42-4546-81b8-bcc059e177b6 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:47 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:47 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 1073741824 Sep 05 20:55:47 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Acquiring lock "cinder-9ca3c236-3639-419c-b99d-00e8dced7825-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Lock "cinder-9ca3c236-3639-419c-b99d-00e8dced7825-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Acquiring lock "cinder-quobyte-9ca3c236-3639-419c-b99d-00e8dced7825" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Lock "cinder-quobyte-9ca3c236-3639-419c-b99d-00e8dced7825" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebc240f-7b1f-4b19-9c4f-486509a6b462]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:47 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 Sep 05 20:55:47 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:47 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 1073741824" returned: 0 in 0.537s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:47 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 Sep 05 20:55:47 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:47 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825" returned: 0 in 0.410s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:47 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825 Sep 05 20:55:47 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:48 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6" returned: 0 in 0.347s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:48 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9ca3c236-3639-419c-b99d-00e8dced7825" returned: 0 in 0.283s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58851102-512d-4f7f-afee-398544ab089a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a848ae-ab42-4546-81b8-bcc059e177b6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527ab97e-a7e8-41cc-b302-a3229b618527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Lock "cinder-quobyte-9ca3c236-3639-419c-b99d-00e8dced7825" released by "delete_volume" :: held 0.752s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Volume volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 (a8a848ae-ab42-4546-81b8-bcc059e177b6): created successfully Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527ab97e-a7e8-41cc-b302-a3229b618527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Flow 'volume_create_manager' (2032a227-239e-48b0-820c-1989443de3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c6bf3637-b095-4738-9d05-2f596231a5e7 tempest-VolumesListAdminTestJSON-172871894 None] Created volume successfully. Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Created reservations ['0598e7d9-32a7-4351-ac02-a92cab502de7', '171d9354-d9ad-4407-8231-9dced8565f8a', 'fc6fe7a1-2dc3-4c1f-b1c1-1971d86bf920', '672d1ff3-640a-4859-94a0-9aa4e2b64764'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:48 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:48 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:48 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.269s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Deleted volume successfully. Sep 05 20:55:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-30631b9c-f9da-479f-9fd4-4fd6eaca519d tempest-VolumesTransfersTest-1855397767 None] Lock "cinder-9ca3c236-3639-419c-b99d-00e8dced7825-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Flow 'volume_create_manager' (f0503774-aceb-48f2-a0d0-012ec4792a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa425730-3713-426b-82da-eeb10dcaffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa425730-3713-426b-82da-eeb10dcaffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d863b3-70c5-41c9-84f5-81aef491e4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318658f8d9f146caa923653fb4e1b83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:50Z,use_quota=True,user_id='1bb9c5c695e94d4fb0e3b0a2e0781a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c706b4-5373-4ea2-8fa3-093022c2a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c706b4-5373-4ea2-8fa3-093022c2a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26ee35b-b271-4fb5-a1ee-69b7ec984d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26ee35b-b271-4fb5-a1ee-69b7ec984d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d863b3-70c5-41c9-84f5-81aef491e4ce', 'volume_name': 'volume-86d863b3-70c5-41c9-84f5-81aef491e4ce', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1f5712-4636-4282-964e-3062a60f36ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1f5712-4636-4282-964e-3062a60f36ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe125d8d-cc66-4a2e-8551-fb75d31fe72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Volume 86d863b3-70c5-41c9-84f5-81aef491e4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d863b3-70c5-41c9-84f5-81aef491e4ce', 'volume_size': 1} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d863b3-70c5-41c9-84f5-81aef491e4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318658f8d9f146caa923653fb4e1b83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:50Z,use_quota=True,user_id='1bb9c5c695e94d4fb0e3b0a2e0781a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Creating volume 86d863b3-70c5-41c9-84f5-81aef491e4ce {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:50 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:50 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce 1073741824 Sep 05 20:55:50 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Flow 'volume_create_manager' (7278f7ab-1ff4-4483-8d05-2f064bf7527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab1568f-f105-49b4-ade1-edee9e84c19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab1568f-f105-49b4-ade1-edee9e84c19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1901623913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d64226-6c13-4dc6-a411-80938ae79f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a4311992164a32b297bae35c117c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:50Z,use_quota=True,user_id='468bd8b34d814dd4ba6c2af046c57839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b806b77-7f0d-43a3-9a46-ec6f81274412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b806b77-7f0d-43a3-9a46-ec6f81274412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dad27bd-1518-40c2-9662-b80e2265bfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dad27bd-1518-40c2-9662-b80e2265bfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d64226-6c13-4dc6-a411-80938ae79f12', 'volume_name': 'volume-76d64226-6c13-4dc6-a411-80938ae79f12', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183facff-525f-45c0-a3cd-4c6ddb3ecd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183facff-525f-45c0-a3cd-4c6ddb3ecd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6740847-db1d-4ce2-8bc7-d95fbf4c0cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Volume 76d64226-6c13-4dc6-a411-80938ae79f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d64226-6c13-4dc6-a411-80938ae79f12', 'volume_size': 1} Sep 05 20:55:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:51 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce 1073741824" returned: 0 in 0.485s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:51 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce Sep 05 20:55:51 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:51 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce" returned: 0 in 0.336s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1901623913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d64226-6c13-4dc6-a411-80938ae79f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a4311992164a32b297bae35c117c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:50Z,use_quota=True,user_id='468bd8b34d814dd4ba6c2af046c57839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Creating volume 76d64226-6c13-4dc6-a411-80938ae79f12 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:51 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe125d8d-cc66-4a2e-8551-fb75d31fe72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d863b3-70c5-41c9-84f5-81aef491e4ce', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:51 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 1073741824 Sep 05 20:55:51 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52452cd0-2bc6-43a9-bee9-eb3515b6772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:51 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Volume volume-86d863b3-70c5-41c9-84f5-81aef491e4ce (86d863b3-70c5-41c9-84f5-81aef491e4ce): created successfully Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52452cd0-2bc6-43a9-bee9-eb3515b6772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Flow 'volume_create_manager' (f0503774-aceb-48f2-a0d0-012ec4792a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2274a589-a42a-4868-a609-570ac7872e0d tempest-VolumesListAdminTestJSON-966552590 None] Created volume successfully. Sep 05 20:55:51 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 1073741824" returned: 0 in 0.539s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:52 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 Sep 05 20:55:52 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:52 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12" returned: 0 in 0.294s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6740847-db1d-4ce2-8bc7-d95fbf4c0cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d64226-6c13-4dc6-a411-80938ae79f12', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0715ba4-a4df-4b68-8e95-a30b81682724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Volume volume-76d64226-6c13-4dc6-a411-80938ae79f12 (76d64226-6c13-4dc6-a411-80938ae79f12): created successfully Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0715ba4-a4df-4b68-8e95-a30b81682724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Flow 'volume_create_manager' (7278f7ab-1ff4-4483-8d05-2f064bf7527c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-51d1f481-95d3-42b1-b80a-f4136da4538a tempest-VolumesTransfersV355Test-1339143274 None] Created volume successfully. Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Acquiring lock "cinder-86d863b3-70c5-41c9-84f5-81aef491e4ce-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Lock "cinder-86d863b3-70c5-41c9-84f5-81aef491e4ce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Acquiring lock "cinder-quobyte-86d863b3-70c5-41c9-84f5-81aef491e4ce" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Lock "cinder-quobyte-86d863b3-70c5-41c9-84f5-81aef491e4ce" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[45899428-29d5-4a6e-b3dc-28742081c5df]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "cinder-a8a848ae-ab42-4546-81b8-bcc059e177b6-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-a8a848ae-ab42-4546-81b8-bcc059e177b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "cinder-quobyte-a8a848ae-ab42-4546-81b8-bcc059e177b6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-quobyte-a8a848ae-ab42-4546-81b8-bcc059e177b6" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d634d7f7-1d96-4d8b-88cf-5d3dcb814825]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:52 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce Sep 05 20:55:52 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:53 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 Sep 05 20:55:53 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:53 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce" returned: 0 in 0.469s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:53 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce Sep 05 20:55:53 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:53 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6" returned: 0 in 0.434s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:53 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6 Sep 05 20:55:53 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:53 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-86d863b3-70c5-41c9-84f5-81aef491e4ce" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Lock "cinder-quobyte-86d863b3-70c5-41c9-84f5-81aef491e4ce" released by "delete_volume" :: held 0.876s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Created reservations ['4b818c35-385b-4901-8240-c93558d6a6d8', '8f964694-3fcb-4318-93dd-350035b7ca0f', '63022099-17b8-4006-8b9e-f3b64190bd9b', '0302fe0c-3098-477a-bf56-580e0688fdbd'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:53 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a8a848ae-ab42-4546-81b8-bcc059e177b6" returned: 0 in 0.338s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-quobyte-a8a848ae-ab42-4546-81b8-bcc059e177b6" released by "delete_volume" :: held 0.838s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:53 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:53 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Created reservations ['423e4f7b-ea62-4e45-a642-aada64288304', 'eb00bb35-08bc-4d90-b20f-e667cb7dd5fa', '44af0934-3d5c-41e4-a5ae-99977c05031e', 'e5c4442c-25e4-4376-983e-5f160c6f0ef4'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:53 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:53 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "cinder-5f800488-99e7-4cf8-aa86-3c5468f56a5f-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:54 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.373s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:54 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Deleted volume successfully. Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-5f800488-99e7-4cf8-aa86-3c5468f56a5f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-89eaee67-5d9f-49de-81d7-3fb982a2e9bd tempest-VolumesListAdminTestJSON-966552590 None] Lock "cinder-86d863b3-70c5-41c9-84f5-81aef491e4ce-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "cinder-quobyte-5f800488-99e7-4cf8-aa86-3c5468f56a5f" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-quobyte-5f800488-99e7-4cf8-aa86-3c5468f56a5f" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5660e3b-c031-4167-baf4-85e46b8257e3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:54 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.421s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:54 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Deleted volume successfully. Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-97163a7c-1c77-440e-9049-d67de4300c10 tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-a8a848ae-ab42-4546-81b8-bcc059e177b6-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:54 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f Sep 05 20:55:54 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:54 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f" returned: 0 in 0.436s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:54 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f Sep 05 20:55:54 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:54 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-35d21921-eacc-4d38-9643-948c0d43a73c tempest-VolumesTransfersV355Test-1963762382 None] Transfer volume completed successfully. Sep 05 20:55:55 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f800488-99e7-4cf8-aa86-3c5468f56a5f" returned: 0 in 0.305s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-quobyte-5f800488-99e7-4cf8-aa86-3c5468f56a5f" released by "delete_volume" :: held 0.797s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Created reservations ['a4aecd35-fe98-4253-8b18-01dc5fe5b872', 'aef2cc8f-e311-49d9-908f-0db0abd9e9ca', '10afdb62-f42d-4d43-977f-d724d2f6fd7d', 'cc2522e6-1da9-4662-8b15-0fa70eb14e78'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:55 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:55 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "cinder-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "cinder-quobyte-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-quobyte-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e86410-a828-4c1b-9483-5a968195f1f7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:55 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.428s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:55 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:55 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Deleted volume successfully. Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0a007e12-7bc6-4d9d-b5c7-442c36ff15bf tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-5f800488-99e7-4cf8-aa86-3c5468f56a5f-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:55 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d Sep 05 20:55:55 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Acquiring lock "cinder-76d64226-6c13-4dc6-a411-80938ae79f12-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Lock "cinder-76d64226-6c13-4dc6-a411-80938ae79f12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Acquiring lock "cinder-quobyte-76d64226-6c13-4dc6-a411-80938ae79f12" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Lock "cinder-quobyte-76d64226-6c13-4dc6-a411-80938ae79f12" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:56 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.431s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef469c-0382-4157-a877-1bfdd8853016]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:56 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d" returned: 0 in 0.512s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:56 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d Sep 05 20:55:56 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:56 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 Sep 05 20:55:56 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:56 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d" returned: 0 in 0.392s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-quobyte-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d" released by "delete_volume" :: held 1.009s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:56 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12" returned: 0 in 0.571s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:56 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12 Sep 05 20:55:56 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Created reservations ['2ebf1816-d833-4409-b465-aaba77bfdd81', 'c2bed10e-5b76-4556-9b8a-7844c1df5360', '8b167a3e-9e96-462a-833d-94f5054534a7', 'e63a73e5-62c4-44ff-ad89-385eb4b4c464'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:56 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:56 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:57 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-76d64226-6c13-4dc6-a411-80938ae79f12" returned: 0 in 0.364s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Lock "cinder-quobyte-76d64226-6c13-4dc6-a411-80938ae79f12" released by "delete_volume" :: held 0.991s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Created reservations ['ea428e33-a337-4e4d-9ea6-22f6de8c3bca', '05b65c0a-35aa-4561-814b-c2f4cc1b17b8', '571df0c1-6974-4c42-a138-e964e9a20d0a', '874c246b-5d8d-4059-a7f5-45b46726a399'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:57 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.366s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Deleted volume successfully. Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-aa7a17ef-4d18-4b99-8ba0-419638629939 tempest-VolumesListAdminTestJSON-172871894 None] Lock "cinder-f8d836cb-0eeb-4e81-ac74-2a36cbae3f4d-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:57 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:55:57 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:57 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.313s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Deleted volume successfully. Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63a167d2-c19f-48b5-bf2b-35796c939f5e tempest-VolumesTransfersV355Test-1547018224 None] Lock "cinder-76d64226-6c13-4dc6-a411-80938ae79f12-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-09e108fd-f4e7-42dc-8c35-2278bf6d38dd req-84613cc5-3af7-4dc0-8da5-0f8c0bacad96 tempest-AttachVolumeTestJSON-265975819 None] Terminate volume connection completed successfully. Sep 05 20:55:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-09e108fd-f4e7-42dc-8c35-2278bf6d38dd req-84613cc5-3af7-4dc0-8da5-0f8c0bacad96 tempest-AttachVolumeTestJSON-265975819 None] Deleting attachment c53ade0f-b067-4e07-b4e9-b444c4731153. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Flow 'volume_create_manager' (90383b38-295c-4f8a-a00b-adb0b75142fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e947ea-f49b-420f-a9c7-9d180dfe0d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e947ea-f49b-420f-a9c7-9d180dfe0d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1222913698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c51be4b-01ae-4b2f-bb2b-791004c79e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a4311992164a32b297bae35c117c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:59Z,use_quota=True,user_id='468bd8b34d814dd4ba6c2af046c57839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7b1cb1-b757-4b33-a02b-22cd6dcaf16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7b1cb1-b757-4b33-a02b-22cd6dcaf16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52241888-75b2-48f8-9fa1-7cbd167e9b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52241888-75b2-48f8-9fa1-7cbd167e9b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c51be4b-01ae-4b2f-bb2b-791004c79e03', 'volume_name': 'volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a5f432-4ad9-4b35-86a5-b85f078cfd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a5f432-4ad9-4b35-86a5-b85f078cfd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95e7105-ffd6-46e9-9dcd-ffeca5989a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Volume 1c51be4b-01ae-4b2f-bb2b-791004c79e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03', 'volume_size': 1} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1222913698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c51be4b-01ae-4b2f-bb2b-791004c79e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a4311992164a32b297bae35c117c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:59Z,use_quota=True,user_id='468bd8b34d814dd4ba6c2af046c57839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Creating volume 1c51be4b-01ae-4b2f-bb2b-791004c79e03 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:55:59 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:59 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 1073741824 Sep 05 20:55:59 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:59 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 1073741824" returned: 0 in 0.581s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:59 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 Sep 05 20:55:59 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:00 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03" returned: 0 in 0.304s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95e7105-ffd6-46e9-9dcd-ffeca5989a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4176d4e9-a8b4-4674-a2b5-7b167a70ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:00 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Volume volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 (1c51be4b-01ae-4b2f-bb2b-791004c79e03): created successfully Sep 05 20:56:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4176d4e9-a8b4-4674-a2b5-7b167a70ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Flow 'volume_create_manager' (90383b38-295c-4f8a-a00b-adb0b75142fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8122f09c-970c-4593-bf23-6cdcec044565 tempest-VolumesTransfersV355Test-1339143274 None] Created volume successfully. Sep 05 20:56:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Acquiring lock "cinder-1c51be4b-01ae-4b2f-bb2b-791004c79e03-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Lock "cinder-1c51be4b-01ae-4b2f-bb2b-791004c79e03-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Acquiring lock "cinder-quobyte-1c51be4b-01ae-4b2f-bb2b-791004c79e03" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Lock "cinder-quobyte-1c51be4b-01ae-4b2f-bb2b-791004c79e03" acquired by "delete_volume" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:01 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8748294-e564-4dfc-94aa-a699c9c8ddb7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:01 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 Sep 05 20:56:01 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:02 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03" returned: 0 in 0.584s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:02 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03 Sep 05 20:56:02 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:02 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c51be4b-01ae-4b2f-bb2b-791004c79e03" returned: 0 in 0.359s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Lock "cinder-quobyte-1c51be4b-01ae-4b2f-bb2b-791004c79e03" released by "delete_volume" :: held 1.042s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Created reservations ['ae1e7bd7-f106-4468-bfe6-1c2f01add422', 'f7070f73-dae1-4959-80f5-54ea02bcd752', '36b01454-31c3-4458-aadb-b2af111fa879', 'f0ac3802-92f0-47c6-ad3a-8afb2a0ad011'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:02 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:56:02 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:03 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:03 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Deleted volume successfully. Sep 05 20:56:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d24398ca-cd8c-4cad-bb4a-77ddfd4c1126 tempest-VolumesTransfersV355Test-1547018224 None] Lock "cinder-1c51be4b-01ae-4b2f-bb2b-791004c79e03-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:06 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Flow 'volume_create_manager' (126d10b9-febe-4cbc-886f-fd718ae59451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e51821c-c250-46ad-80aa-d2e3551feec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e51821c-c250-46ad-80aa-d2e3551feec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-916010978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08c832f-9427-4466-8742-a5573a02e987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce1d1a58d08406caec05b58dcd71b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:07Z,use_quota=True,user_id='bc6965bc15274d208d2b6b2be3e2d336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67191faf-0b2a-48cc-9331-273141800947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67191faf-0b2a-48cc-9331-273141800947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a23b470-434b-40a1-8b77-d4e8071b1bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:06 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 20:56:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a23b470-434b-40a1-8b77-d4e8071b1bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c08c832f-9427-4466-8742-a5573a02e987', 'volume_name': 'volume-c08c832f-9427-4466-8742-a5573a02e987', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a273574-6f0e-4667-92e6-d66d6f6e8b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a273574-6f0e-4667-92e6-d66d6f6e8b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3d31f7-2935-47c1-be04-c471e152b930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:08 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Volume c08c832f-9427-4466-8742-a5573a02e987: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c08c832f-9427-4466-8742-a5573a02e987', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 20:56:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Trying to clone c08c832f-9427-4466-8742-a5573a02e987 from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 20:56:08 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 20:56:08 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Image download 20.69 MB at 20.69 MB/s Sep 05 20:56:08 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cadce6-13db-4501-bb5a-83490ee57df0]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:09 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD Sep 05 20:56:09 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:09 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:09 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df is fetched for user bc6965bc15274d208d2b6b2be3e2d336. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 20:56:09 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3ef2ee-cef5-4dd2-a8a6-74e966f989a0]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:09 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD Sep 05 20:56:09 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:10 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-916010978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08c832f-9427-4466-8742-a5573a02e987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce1d1a58d08406caec05b58dcd71b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:07Z,use_quota=True,user_id='bc6965bc15274d208d2b6b2be3e2d336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Creating volume c08c832f-9427-4466-8742-a5573a02e987 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:56:10 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:10 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 1073741824 Sep 05 20:56:10 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:10 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 1073741824" returned: 0 in 0.639s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:10 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 Sep 05 20:56:10 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:11 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:11 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Attempting download of 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume c08c832f-9427-4466-8742-a5573a02e987. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 20:56:11 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c27bf8-0736-4d72-8ac0-6b1c63d9db7a]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_7x_acy79 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:11 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_7x_acy79 Sep 05 20:56:11 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:11 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_7x_acy79" returned: 0 in 0.496s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_7x_acy79 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:12 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_7x_acy79 Sep 05 20:56:12 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:12 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_7x_acy79" returned: 1 in 0.657s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_7x_acy79' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:56:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e49b02a-3415-4644-b735-eb23826bd383]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:12 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD Sep 05 20:56:12 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:12 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:12 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df was qcow2, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 20:56:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:12 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 Sep 05 20:56:12 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Flow 'volume_create_manager' (17f184a8-e5e0-4da1-aa31-be39bec1c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147b2dac-4124-4f7e-a7e3-46b756159b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147b2dac-4124-4f7e-a7e3-46b756159b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1221647367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0acf17d08cd45fe90e1601e7715c03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:13Z,use_quota=True,user_id='11cce6f6f0e5486e940087eac8fff2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcda636-d11a-4b6d-8643-9370841f703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcda636-d11a-4b6d-8643-9370841f703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea602a9-5024-4bac-9df2-8021304fa744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea602a9-5024-4bac-9df2-8021304fa744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b', 'volume_name': 'volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcbbba9-653c-4625-bae5-7a77b720df1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcbbba9-653c-4625-bae5-7a77b720df1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363f3c2e-02b4-4132-b789-e5968077f020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:13 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Volume ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b', 'volume_size': 1} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1221647367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0acf17d08cd45fe90e1601e7715c03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:13Z,use_quota=True,user_id='11cce6f6f0e5486e940087eac8fff2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Creating volume ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:56:13 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:13 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b 1073741824 Sep 05 20:56:13 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:13 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b 1073741824" returned: 0 in 0.543s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:14 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:56:14 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:14 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363f3c2e-02b4-4132-b789-e5968077f020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350724dc-f4a5-485a-a3ec-1a61880d33dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:14 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Volume volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b (ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b): created successfully Sep 05 20:56:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350724dc-f4a5-485a-a3ec-1a61880d33dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Flow 'volume_create_manager' (17f184a8-e5e0-4da1-aa31-be39bec1c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:14 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-66a2a798-ea90-41d9-9622-fe26a7db385b tempest-VolumesActionsTest-1248288493 None] Created volume successfully. Sep 05 20:56:15 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987" returned: 0 in 2.221s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_o9ygrcxddevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:56:15 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Converted 112.00 MB image at 50.41 MB/s Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:15 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 1G Sep 05 20:56:15 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:15 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 1G" returned: 0 in 0.444s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Downloaded image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume c08c832f-9427-4466-8742-a5573a02e987 successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df for user bc6965bc15274d208d2b6b2be3e2d336 is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Marking volume c08c832f-9427-4466-8742-a5573a02e987 as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Copying metadata from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df to c08c832f-9427-4466-8742-a5573a02e987. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Creating volume glance metadata for volume c08c832f-9427-4466-8742-a5573a02e987 backed by image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3d31f7-2935-47c1-be04-c471e152b930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08c832f-9427-4466-8742-a5573a02e987', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584d1af1-aa4d-44ad-90c8-dcdeb1ff41d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:15 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Volume volume-c08c832f-9427-4466-8742-a5573a02e987 (c08c832f-9427-4466-8742-a5573a02e987): created successfully Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584d1af1-aa4d-44ad-90c8-dcdeb1ff41d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Flow 'volume_create_manager' (126d10b9-febe-4cbc-886f-fd718ae59451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:15 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1efd3d06-479c-4203-ac09-61a12556b09b tempest-VolumesImageMetadata-1759019258 None] Created volume successfully. Sep 05 20:56:15 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=148,cinder:SELECT=106,cinder:DELETE=13,cinder:INSERT=40 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Flow 'volume_create_manager' (834bec7e-64cd-4664-ab0c-38dfc6adfc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2196d0d1-65ca-4363-9fb9-3530f7745a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2196d0d1-65ca-4363-9fb9-3530f7745a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1385348547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae182aea-3ac7-4422-84bb-831b342e5818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c0ec0e837d440fa99bcc72d9000f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:16Z,use_quota=True,user_id='a952728b6c04471b9e5e04f882ceb662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90ee178-2990-43ea-aa10-da8f20cf22fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90ee178-2990-43ea-aa10-da8f20cf22fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9722a3ff-1b0a-4a35-9c51-a583948a6e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9722a3ff-1b0a-4a35-9c51-a583948a6e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae182aea-3ac7-4422-84bb-831b342e5818', 'volume_name': 'volume-ae182aea-3ac7-4422-84bb-831b342e5818', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33008de7-4d35-4ae6-8257-14b006ebf565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33008de7-4d35-4ae6-8257-14b006ebf565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ddb77e-b6e8-4c86-8831-2fc8c79b2e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:16 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Volume ae182aea-3ac7-4422-84bb-831b342e5818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae182aea-3ac7-4422-84bb-831b342e5818', 'volume_size': 1} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1385348547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae182aea-3ac7-4422-84bb-831b342e5818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c0ec0e837d440fa99bcc72d9000f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:16Z,use_quota=True,user_id='a952728b6c04471b9e5e04f882ceb662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Creating volume ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:56:16 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:16 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 1073741824 Sep 05 20:56:16 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:16 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 1073741824" returned: 0 in 0.617s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=138,cinder:SELECT=100,cinder:INSERT=38,cinder:DELETE=13 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:56:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:16 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 Sep 05 20:56:16 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:17 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818" returned: 0 in 0.326s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ddb77e-b6e8-4c86-8831-2fc8c79b2e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae182aea-3ac7-4422-84bb-831b342e5818', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b70f8f-b9f5-4aba-ac68-0391a68f213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:17 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Volume volume-ae182aea-3ac7-4422-84bb-831b342e5818 (ae182aea-3ac7-4422-84bb-831b342e5818): created successfully Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b70f8f-b9f5-4aba-ac68-0391a68f213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Flow 'volume_create_manager' (834bec7e-64cd-4664-ab0c-38dfc6adfc77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:17 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9b8a3c3d-4780-4a5a-a150-4e61bac16fae tempest-VolumesCloneTest-598429253 None] Created volume successfully. Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Acquiring lock "cinder-c08c832f-9427-4466-8742-a5573a02e987-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Lock "cinder-c08c832f-9427-4466-8742-a5573a02e987-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Acquiring lock "cinder-quobyte-c08c832f-9427-4466-8742-a5573a02e987" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Lock "cinder-quobyte-c08c832f-9427-4466-8742-a5573a02e987" acquired by "delete_volume" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef3e66a-6d8f-4dad-8876-a2ceb6b89ac2]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:17 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 Sep 05 20:56:17 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:17 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987" returned: 0 in 0.464s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:17 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987 Sep 05 20:56:17 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:18 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c08c832f-9427-4466-8742-a5573a02e987" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Lock "cinder-quobyte-c08c832f-9427-4466-8742-a5573a02e987" released by "delete_volume" :: held 0.858s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Created reservations ['c83c6947-f985-47b8-9c69-18df7deb9918', '80563702-3762-4ea6-877b-6af3dd730057', 'ced02990-b6ca-4d8b-8407-ca9c43624d1c', 'fa11ed9c-0794-48fb-a4a9-3835c0b7a3dc'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:18 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:56:18 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:19 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.546s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Deleted volume successfully. Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f55bb579-18fd-4838-a911-c495b5a6b654 tempest-VolumesImageMetadata-1759019258 None] Lock "cinder-c08c832f-9427-4466-8742-a5573a02e987-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Flow 'volume_create_manager' (e5981f48-6e71-4509-80a9-e9d61cbcc3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3631c1-4cf7-477a-8b89-3efad08ee8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3631c1-4cf7-477a-8b89-3efad08ee8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-114452425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5216470a-8b7e-4ce6-960f-eba49f36a6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c0ec0e837d440fa99bcc72d9000f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ae182aea-3ac7-4422-84bb-831b342e5818,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:19Z,use_quota=True,user_id='a952728b6c04471b9e5e04f882ceb662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17293068-21d8-42ca-8df7-c924b7ca8d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17293068-21d8-42ca-8df7-c924b7ca8d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ef7969-43ca-440e-9135-288f99436025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ef7969-43ca-440e-9135-288f99436025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5216470a-8b7e-4ce6-960f-eba49f36a6c6', 'volume_name': 'volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6', 'volume_size': 2, 'source_volid': 'ae182aea-3ac7-4422-84bb-831b342e5818', 'source_volstatus': 'available'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf92989-bc47-451f-9ce2-c3322b9b1d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf92989-bc47-451f-9ce2-c3322b9b1d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4171473-dba6-4242-ac24-45127415d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:19 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Volume 5216470a-8b7e-4ce6-960f-eba49f36a6c6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6', 'volume_size': 2, 'source_volid': 'ae182aea-3ac7-4422-84bb-831b342e5818', 'source_volstatus': 'available'} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:19 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Cloning volume ae182aea-3ac7-4422-84bb-831b342e5818 to volume 5216470a-8b7e-4ce6-960f-eba49f36a6c6 Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Creating offline snapshot df10c977-db86-4a3a-8ebc-f4a86dac995b of volume ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebbb6df-4f90-4bc0-9205-0975f686a421]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:19 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 Sep 05 20:56:19 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:20 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818" returned: 0 in 0.614s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:20 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b 1G Sep 05 20:56:20 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:20 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b 1G" returned: 0 in 0.565s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae182aea-3ac7-4422-84bb-831b342e5818 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:20 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae182aea-3ac7-4422-84bb-831b342e5818 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b Sep 05 20:56:20 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:21 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae182aea-3ac7-4422-84bb-831b342e5818 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b" returned: 0 in 0.356s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:21 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b is being set with open permissions: ugo+rw Sep 05 20:56:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:21 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b Sep 05 20:56:21 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:21 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b" returned: 0 in 0.303s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:21 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.info Sep 05 20:56:21 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:21 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.info" returned: 0 in 0.349s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:21 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.info is being set with open permissions: ugo+rw Sep 05 20:56:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:21 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.info Sep 05 20:56:21 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:22 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.info" returned: 0 in 0.287s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Acquiring lock "cinder-quobyte-5216470a-8b7e-4ce6-960f-eba49f36a6c6" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Lock "cinder-quobyte-5216470a-8b7e-4ce6-960f-eba49f36a6c6" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] snapshot: df10c977-db86-4a3a-8ebc-f4a86dac995b, volume: 5216470a-8b7e-4ce6-960f-eba49f36a6c6, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[559c21fd-abd6-482c-ac96-02c24eed5654]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:22 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b Sep 05 20:56:22 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:23 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b" returned: 0 in 0.878s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae182aea-3ac7-4422-84bb-831b342e5818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[71295c7f-5198-4d83-89f2-e9a8e409074e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:23 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 Sep 05 20:56:23 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:23 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818" returned: 0 in 0.681s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:56:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:23 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 Sep 05 20:56:23 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b85d390-ae6c-410c-83a2-78a9a3ce50bf tempest-VolumesActionsTest-1248288493 None] Acquiring lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" by "attach_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b85d390-ae6c-410c-83a2-78a9a3ce50bf tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" acquired by "attach_volume" :: waited 0.056s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3b85d390-ae6c-410c-83a2-78a9a3ce50bf tempest-VolumesActionsTest-1248288493 None] Attaching volume ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b to instance 34b1325c-3dfd-436d-ae6b-58e34cffb6a0 at mountpoint /dev/vdb on host None. Sep 05 20:56:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3b85d390-ae6c-410c-83a2-78a9a3ce50bf tempest-VolumesActionsTest-1248288493 None] Attach volume completed successfully. Sep 05 20:56:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b85d390-ae6c-410c-83a2-78a9a3ce50bf tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" released by "attach_volume" :: held 0.303s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1ecff8e4-67d0-4706-8d9f-9810bc33b775 tempest-VolumesActionsTest-1248288493 None] Acquiring lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-detach_volume" by "detach_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1ecff8e4-67d0-4706-8d9f-9810bc33b775 tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-detach_volume" acquired by "detach_volume" :: waited 0.088s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1ecff8e4-67d0-4706-8d9f-9810bc33b775 tempest-VolumesActionsTest-1248288493 None] Detaching volume ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b from instance 34b1325c-3dfd-436d-ae6b-58e34cffb6a0. Sep 05 20:56:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1ecff8e4-67d0-4706-8d9f-9810bc33b775 tempest-VolumesActionsTest-1248288493 None] Detach volume completed successfully. Sep 05 20:56:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1ecff8e4-67d0-4706-8d9f-9810bc33b775 tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-detach_volume" released by "detach_volume" :: held 0.283s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:32 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Flow 'volume_create_manager' (661d67b8-293d-407c-8526-07ef45daa25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a6fe9-f158-491e-9be3-cb6c59151c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6" returned: 0 in 8.952s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818, size 1024.00 MB, duration 8.96 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:56:32 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Converted 1024.00 MB image at 114.24 MB/s Sep 05 20:56:32 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 is being set with open permissions: ugo+rw Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a6fe9-f158-491e-9be3-cb6c59151c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-755671302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8013b957-37e7-449c-8c6b-7ff638e7c65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a57b0525dce4dc2bafd73d6a1b8f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:33Z,use_quota=True,user_id='2d5cb451b58e4d7eaaae944d2f8c8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19081fb1-9de2-4a10-a161-8dd3521b9b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19081fb1-9de2-4a10-a161-8dd3521b9b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:32 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 Sep 05 20:56:32 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462a3d3a-f758-40ed-b629-3bfe9821e8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462a3d3a-f758-40ed-b629-3bfe9821e8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8013b957-37e7-449c-8c6b-7ff638e7c65b', 'volume_name': 'volume-8013b957-37e7-449c-8c6b-7ff638e7c65b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73348ef-68aa-46ca-9a6e-c554dd56992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73348ef-68aa-46ca-9a6e-c554dd56992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676d3282-de94-4af4-a9d8-9684474f6ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:32 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Volume 8013b957-37e7-449c-8c6b-7ff638e7c65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8013b957-37e7-449c-8c6b-7ff638e7c65b', 'volume_size': 1} Sep 05 20:56:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:33 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6" returned: 0 in 0.560s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Lock "cinder-quobyte-5216470a-8b7e-4ce6-960f-eba49f36a6c6" released by "_copy_volume_from_snapshot" :: held 11.209s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Acquiring lock "cinder-quobyte-df10c977-db86-4a3a-8ebc-f4a86dac995b" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Lock "cinder-quobyte-df10c977-db86-4a3a-8ebc-f4a86dac995b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Deleting offline snapshot df10c977-db86-4a3a-8ebc-f4a86dac995b of volume ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:56:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] snapshot_file for this snap is: volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:56:33 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0813ec5-291c-4d29-bfd8-0e6997de0564]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:33 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b Sep 05 20:56:33 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:34 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b" returned: 0 in 0.630s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae182aea-3ac7-4422-84bb-831b342e5818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:56:34 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df427a1-1593-46ea-943d-2630a2233f1e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:34 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 Sep 05 20:56:34 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:34 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818" returned: 0 in 0.787s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:35 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b Sep 05 20:56:35 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:35 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b" returned: 0 in 0.376s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:35 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b Sep 05 20:56:35 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:35 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818.df10c977-db86-4a3a-8ebc-f4a86dac995b" returned: 0 in 0.351s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Lock "cinder-quobyte-df10c977-db86-4a3a-8ebc-f4a86dac995b" released by "_delete_snapshot" :: held 2.340s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.338s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-755671302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8013b957-37e7-449c-8c6b-7ff638e7c65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a57b0525dce4dc2bafd73d6a1b8f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:33Z,use_quota=True,user_id='2d5cb451b58e4d7eaaae944d2f8c8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Creating volume 8013b957-37e7-449c-8c6b-7ff638e7c65b {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:56:35 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4171473-dba6-4242-ac24-45127415d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6', 'volume_size': 2, 'source_volid': 'ae182aea-3ac7-4422-84bb-831b342e5818', 'source_volstatus': 'available'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:35 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b 1073741824 Sep 05 20:56:35 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc2d749-f0ca-403a-af14-41270499ece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Volume volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 (5216470a-8b7e-4ce6-960f-eba49f36a6c6): created successfully Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc2d749-f0ca-403a-af14-41270499ece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Flow 'volume_create_manager' (e5981f48-6e71-4509-80a9-e9d61cbcc3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-67145ecc-379c-40be-86a8-d3c353f3d79b tempest-VolumesCloneTest-598429253 None] Created volume successfully. Sep 05 20:56:36 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b 1073741824" returned: 0 in 0.640s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:36 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b Sep 05 20:56:36 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:36 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b" returned: 0 in 0.416s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676d3282-de94-4af4-a9d8-9684474f6ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8013b957-37e7-449c-8c6b-7ff638e7c65b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90d7ae6-9cd1-4727-b874-a6e113807efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Acquiring lock "cinder-5216470a-8b7e-4ce6-960f-eba49f36a6c6-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:37 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Volume volume-8013b957-37e7-449c-8c6b-7ff638e7c65b (8013b957-37e7-449c-8c6b-7ff638e7c65b): created successfully Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90d7ae6-9cd1-4727-b874-a6e113807efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Flow 'volume_create_manager' (661d67b8-293d-407c-8526-07ef45daa25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Lock "cinder-5216470a-8b7e-4ce6-960f-eba49f36a6c6-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:37 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8621fb08-0f8b-4459-b8e1-e271d29f8b46 tempest-VolumesTransfersV357Test-382790522 None] Created volume successfully. Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Acquiring lock "cinder-quobyte-5216470a-8b7e-4ce6-960f-eba49f36a6c6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Lock "cinder-quobyte-5216470a-8b7e-4ce6-960f-eba49f36a6c6" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a16096-a138-4b61-98df-9de1c6242d1c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:37 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 Sep 05 20:56:37 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:37 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6" returned: 0 in 0.478s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:37 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6 Sep 05 20:56:37 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:37 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5216470a-8b7e-4ce6-960f-eba49f36a6c6" returned: 0 in 0.326s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Lock "cinder-quobyte-5216470a-8b7e-4ce6-960f-eba49f36a6c6" released by "delete_volume" :: held 0.858s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Created reservations ['72086fe6-c1cb-407f-81b0-220e8eaf14d5', 'bca041af-c29f-4ae0-8122-d7ddfac835ef', 'f7679765-65dc-4230-852b-1fe0262e6f2d', '7db2317b-d710-4960-a7d0-1cc4ba676407'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:38 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:56:38 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Acquiring lock "cinder-ae182aea-3ac7-4422-84bb-831b342e5818-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Lock "cinder-ae182aea-3ac7-4422-84bb-831b342e5818-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Acquiring lock "cinder-quobyte-ae182aea-3ac7-4422-84bb-831b342e5818" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Lock "cinder-quobyte-ae182aea-3ac7-4422-84bb-831b342e5818" acquired by "delete_volume" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:38 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.483s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Deleted volume successfully. Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8753a0e8-aa30-43b2-afe1-894303abfd79]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ecf89f59-9bd5-4990-9b9d-dbb356040fb7 tempest-VolumesCloneTest-598429253 None] Lock "cinder-5216470a-8b7e-4ce6-960f-eba49f36a6c6-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:39 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 Sep 05 20:56:39 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:39 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818" returned: 0 in 0.607s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:39 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818 Sep 05 20:56:39 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f603d6d4-d9d7-461c-b7b7-13e790bd59af tempest-VolumesTransfersV357Test-1311887310 None] Transfer volume completed successfully. Sep 05 20:56:39 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae182aea-3ac7-4422-84bb-831b342e5818" returned: 0 in 0.533s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Lock "cinder-quobyte-ae182aea-3ac7-4422-84bb-831b342e5818" released by "delete_volume" :: held 1.293s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Created reservations ['4e3eab52-61cf-46b1-9d70-05b652bcf176', '5addd7b4-6697-4b27-b949-3ae6f39b9b71', '0ae8353c-19eb-47a9-bb71-7bb998f2c752', '89947e7c-9478-4d8c-8956-a50cb837db1d'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:40 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:56:40 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Acquiring lock "cinder-8013b957-37e7-449c-8c6b-7ff638e7c65b-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Lock "cinder-8013b957-37e7-449c-8c6b-7ff638e7c65b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:40 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.297s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Deleted volume successfully. Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Acquiring lock "cinder-quobyte-8013b957-37e7-449c-8c6b-7ff638e7c65b" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Lock "cinder-quobyte-8013b957-37e7-449c-8c6b-7ff638e7c65b" acquired by "delete_volume" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7d97be3a-4a2e-4f1a-95bc-6375c6a37626 tempest-VolumesCloneTest-598429253 None] Lock "cinder-ae182aea-3ac7-4422-84bb-831b342e5818-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[497ebd7d-7b19-4849-b380-5e29bbd61139]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:40 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b Sep 05 20:56:40 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:41 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b" returned: 0 in 0.553s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:41 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b Sep 05 20:56:41 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:41 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8013b957-37e7-449c-8c6b-7ff638e7c65b" returned: 0 in 0.373s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Lock "cinder-quobyte-8013b957-37e7-449c-8c6b-7ff638e7c65b" released by "delete_volume" :: held 0.995s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Created reservations ['11510636-f844-4a26-bab5-1e454058bab4', '93e0902d-16bb-469a-aa1e-d8ab9b80bcb5', '0e5f9cd4-a9c5-45a7-901c-2f801e517082', '7dd11465-ddbc-4752-b5bb-0731f7f1d8fa'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:41 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:56:41 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:42 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.368s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:42 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Deleted volume successfully. Sep 05 20:56:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9ab45910-51a5-4d26-899b-75eaf779ab4b tempest-VolumesTransfersV357Test-649737900 None] Lock "cinder-8013b957-37e7-449c-8c6b-7ff638e7c65b-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Flow 'volume_create_manager' (f897f4ed-e212-4797-8548-a4b116133075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b138f3-ec58-4ca3-850b-56f28c61df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b138f3-ec58-4ca3-850b-56f28c61df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-220201272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212e8b4d-3af6-48be-ad43-e6b791deb946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a57b0525dce4dc2bafd73d6a1b8f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:44Z,use_quota=True,user_id='2d5cb451b58e4d7eaaae944d2f8c8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b473d67c-1eef-4ef9-9a43-10178cd05b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b473d67c-1eef-4ef9-9a43-10178cd05b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd2df54-e19e-42d7-941f-57d54b825602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd2df54-e19e-42d7-941f-57d54b825602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212e8b4d-3af6-48be-ad43-e6b791deb946', 'volume_name': 'volume-212e8b4d-3af6-48be-ad43-e6b791deb946', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af817a7-2674-4dd8-9d3b-809e06668c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af817a7-2674-4dd8-9d3b-809e06668c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fc18e8-5f11-4ab3-a15d-294d1ceb5176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:44 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Volume 212e8b4d-3af6-48be-ad43-e6b791deb946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212e8b4d-3af6-48be-ad43-e6b791deb946', 'volume_size': 1} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-220201272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212e8b4d-3af6-48be-ad43-e6b791deb946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a57b0525dce4dc2bafd73d6a1b8f11a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:44Z,use_quota=True,user_id='2d5cb451b58e4d7eaaae944d2f8c8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Creating volume 212e8b4d-3af6-48be-ad43-e6b791deb946 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:56:44 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:56:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:44 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 1073741824 Sep 05 20:56:44 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:45 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 1073741824" returned: 0 in 1.035s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:45 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 Sep 05 20:56:45 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:45 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946" returned: 0 in 0.627s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fc18e8-5f11-4ab3-a15d-294d1ceb5176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212e8b4d-3af6-48be-ad43-e6b791deb946', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e9ff69-c781-42a8-bc8a-1374091a9c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:46 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Volume volume-212e8b4d-3af6-48be-ad43-e6b791deb946 (212e8b4d-3af6-48be-ad43-e6b791deb946): created successfully Sep 05 20:56:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e9ff69-c781-42a8-bc8a-1374091a9c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Flow 'volume_create_manager' (f897f4ed-e212-4797-8548-a4b116133075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:46 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-78ce371c-93ca-41be-97b8-5c5b63db189a tempest-VolumesTransfersV357Test-382790522 None] Created volume successfully. Sep 05 20:56:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7cf08281-8675-40b1-8801-0958b588e8a9 tempest-VolumesActionsTest-1248288493 None] Acquiring lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" by "attach_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7cf08281-8675-40b1-8801-0958b588e8a9 tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" acquired by "attach_volume" :: waited 0.050s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7cf08281-8675-40b1-8801-0958b588e8a9 tempest-VolumesActionsTest-1248288493 None] Attaching volume ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b to instance b8c53f6f-f761-4d27-b560-855ff0af4d74 at mountpoint /dev/vdb on host None. Sep 05 20:56:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7cf08281-8675-40b1-8801-0958b588e8a9 tempest-VolumesActionsTest-1248288493 None] Attach volume completed successfully. Sep 05 20:56:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7cf08281-8675-40b1-8801-0958b588e8a9 tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" released by "attach_volume" :: held 0.188s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-efca4b62-a24c-459c-8c5e-2af31eee9eed tempest-VolumesActionsTest-1248288493 None] Acquiring lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-detach_volume" by "detach_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-efca4b62-a24c-459c-8c5e-2af31eee9eed tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-efca4b62-a24c-459c-8c5e-2af31eee9eed tempest-VolumesActionsTest-1248288493 None] Detaching volume ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b from instance b8c53f6f-f761-4d27-b560-855ff0af4d74. Sep 05 20:56:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-efca4b62-a24c-459c-8c5e-2af31eee9eed tempest-VolumesActionsTest-1248288493 None] Detach volume completed successfully. Sep 05 20:56:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-efca4b62-a24c-459c-8c5e-2af31eee9eed tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Flow 'volume_create_manager' (4b6afb54-f76b-40e0-bedf-0210de45ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6cd868-1579-4dec-8f35-9a08388fa23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6cd868-1579-4dec-8f35-9a08388fa23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-41824091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57b0644-1a17-4812-89c3-fe71894b271d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25762c088bb481ca12afb914e009798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:48Z,use_quota=True,user_id='94787724bb4449fea12cc858f95afd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c29098a-1715-44b3-be04-a967584d9f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c29098a-1715-44b3-be04-a967584d9f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdd09bf-38f6-46eb-be65-725ed4a45213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdd09bf-38f6-46eb-be65-725ed4a45213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57b0644-1a17-4812-89c3-fe71894b271d', 'volume_name': 'volume-c57b0644-1a17-4812-89c3-fe71894b271d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6270808-5117-4287-b7d5-95402883cacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6270808-5117-4287-b7d5-95402883cacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8508bf-7e18-436b-b177-30865eb723ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Volume c57b0644-1a17-4812-89c3-fe71894b271d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57b0644-1a17-4812-89c3-fe71894b271d', 'volume_size': 1} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-41824091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57b0644-1a17-4812-89c3-fe71894b271d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25762c088bb481ca12afb914e009798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:48Z,use_quota=True,user_id='94787724bb4449fea12cc858f95afd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Creating volume c57b0644-1a17-4812-89c3-fe71894b271d {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:56:48 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:48 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d 1073741824 Sep 05 20:56:48 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Acquiring lock "cinder-212e8b4d-3af6-48be-ad43-e6b791deb946-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Lock "cinder-212e8b4d-3af6-48be-ad43-e6b791deb946-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Acquiring lock "cinder-quobyte-212e8b4d-3af6-48be-ad43-e6b791deb946" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Lock "cinder-quobyte-212e8b4d-3af6-48be-ad43-e6b791deb946" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c8425b-80f1-49f3-846f-3cf710588099]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:49 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 Sep 05 20:56:49 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:49 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d 1073741824" returned: 0 in 0.876s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:49 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d Sep 05 20:56:49 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:49 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946" returned: 0 in 0.634s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:49 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946 Sep 05 20:56:49 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:49 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d" returned: 0 in 0.419s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8508bf-7e18-436b-b177-30865eb723ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57b0644-1a17-4812-89c3-fe71894b271d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e99362-d278-4298-9741-af5e0e2bbdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:50 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Volume volume-c57b0644-1a17-4812-89c3-fe71894b271d (c57b0644-1a17-4812-89c3-fe71894b271d): created successfully Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e99362-d278-4298-9741-af5e0e2bbdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Flow 'volume_create_manager' (4b6afb54-f76b-40e0-bedf-0210de45ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:50 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-212e8b4d-3af6-48be-ad43-e6b791deb946" returned: 0 in 0.527s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bf764b51-e68d-4e9e-8182-de011da4e989 tempest-VolumesListTestJSON-287466932 None] Created volume successfully. Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Lock "cinder-quobyte-212e8b4d-3af6-48be-ad43-e6b791deb946" released by "delete_volume" :: held 1.248s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Created reservations ['8b6a2fb6-c756-48b3-bcd4-16e52c0364e2', 'b198a09c-c2f2-4f9d-97bc-af4f37594524', '14baeaf0-d32b-4189-80b6-9dd8468f73be', '0cae30eb-f7f8-4e52-91f6-3067e63ef292'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:50 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:56:50 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:51 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.824s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Deleted volume successfully. Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5d2a6371-4df6-4737-a802-3e32c0f8773b tempest-VolumesTransfersV357Test-649737900 None] Lock "cinder-212e8b4d-3af6-48be-ad43-e6b791deb946-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Flow 'volume_create_manager' (fe9b3b7f-e7fc-4d56-95f8-a928094635fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f66647-62bc-419f-8b2e-70df95be0ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f66647-62bc-419f-8b2e-70df95be0ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-103577033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e896dd58-f1a7-4bff-938e-d6550f165e74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25762c088bb481ca12afb914e009798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:52Z,use_quota=True,user_id='94787724bb4449fea12cc858f95afd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29775b1-cca9-4398-a899-bcc4fb8140bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29775b1-cca9-4398-a899-bcc4fb8140bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009cd72c-10fd-4f79-9249-5a44d8857fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009cd72c-10fd-4f79-9249-5a44d8857fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e896dd58-f1a7-4bff-938e-d6550f165e74', 'volume_name': 'volume-e896dd58-f1a7-4bff-938e-d6550f165e74', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b82b24-b9ba-4dab-942c-5ec0a6d40356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b82b24-b9ba-4dab-942c-5ec0a6d40356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f5e655-23f5-460c-8d08-bad1c0191313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Volume e896dd58-f1a7-4bff-938e-d6550f165e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e896dd58-f1a7-4bff-938e-d6550f165e74', 'volume_size': 1} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-103577033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e896dd58-f1a7-4bff-938e-d6550f165e74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25762c088bb481ca12afb914e009798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:52Z,use_quota=True,user_id='94787724bb4449fea12cc858f95afd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Creating volume e896dd58-f1a7-4bff-938e-d6550f165e74 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:56:52 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:52 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 1073741824 Sep 05 20:56:52 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:52 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 1073741824" returned: 0 in 0.570s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:52 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 Sep 05 20:56:52 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:52 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74" returned: 0 in 0.277s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f5e655-23f5-460c-8d08-bad1c0191313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e896dd58-f1a7-4bff-938e-d6550f165e74', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd5735-45dc-47ca-84dc-dd71e67e0c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Volume volume-e896dd58-f1a7-4bff-938e-d6550f165e74 (e896dd58-f1a7-4bff-938e-d6550f165e74): created successfully Sep 05 20:56:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd5735-45dc-47ca-84dc-dd71e67e0c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Flow 'volume_create_manager' (fe9b3b7f-e7fc-4d56-95f8-a928094635fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-49f63eec-e3ce-4740-98ab-6b089a206e76 tempest-VolumesListTestJSON-287466932 None] Created volume successfully. Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd2ae3d-99d9-4a2a-84cd-e3a44eb490c0]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:54 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:56:54 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Flow 'volume_create_manager' (5ebee355-819a-4674-a759-d0e43fc13ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5afe8e-7926-49e3-a430-c744c3501eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5afe8e-7926-49e3-a430-c744c3501eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-874554948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098c9a15-db94-4b6f-86ee-0f2f7ed7531e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25762c088bb481ca12afb914e009798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:54Z,use_quota=True,user_id='94787724bb4449fea12cc858f95afd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e23f15-86dd-400f-9095-4209d2ed50b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e23f15-86dd-400f-9095-4209d2ed50b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1733f77e-1183-4488-9f08-40629fa130fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1733f77e-1183-4488-9f08-40629fa130fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098c9a15-db94-4b6f-86ee-0f2f7ed7531e', 'volume_name': 'volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32564c9d-62a0-4cf1-8d55-88474892da8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32564c9d-62a0-4cf1-8d55-88474892da8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ffc3b7-638c-455f-8b23-8e7f89ae0f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Volume 098c9a15-db94-4b6f-86ee-0f2f7ed7531e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e', 'volume_size': 1} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:54 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.462s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7dc8de-bf14-4bf7-a639-b3c5101e5796]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:54 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:56:54 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:55 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.454s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.45fa7a61-f729-4b7b-8eb4-0a1e35d19809zp06vyoh.img {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:55 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.45fa7a61-f729-4b7b-8eb4-0a1e35d19809zp06vyoh.img Sep 05 20:56:55 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:55 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:56:55 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:56 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 1.286s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:57 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:56:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:56:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:57:02 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.45fa7a61-f729-4b7b-8eb4-0a1e35d19809zp06vyoh.img" returned: 0 in 6.829s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56dc000-f717-436b-b268-4a90155fc51f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:02 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:57:02 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:02 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.564s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:02 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.45fa7a61-f729-4b7b-8eb4-0a1e35d19809zp06vyoh.img {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:57:02 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Converted 1024.00 MB image at 149.92 MB/s Sep 05 20:57:02 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] 45fa7a61-f729-4b7b-8eb4-0a1e35d19809 was raw, no need to convert to raw {{(pid=87802) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Flow 'volume_create_manager' (7da5eeb6-86e3-4315-93ce-9ddedc06d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ede82b-7972-4d0c-8b40-234ec89fdb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ede82b-7972-4d0c-8b40-234ec89fdb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2025301978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db578dab-a87c-496b-adec-916d03add892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff020cc101cf4041a7f2984a318f6075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:04Z,use_quota=True,user_id='2ce5420d9f054d39a8acacb3a59d7935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e491d5e0-c611-49f5-8a4f-080f643499df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e491d5e0-c611-49f5-8a4f-080f643499df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b059a546-d711-41af-97af-37197701e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b059a546-d711-41af-97af-37197701e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db578dab-a87c-496b-adec-916d03add892', 'volume_name': 'volume-db578dab-a87c-496b-adec-916d03add892', 'volume_size': 2}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e84343c-8ac7-40a1-896b-8d8796cc1c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e84343c-8ac7-40a1-896b-8d8796cc1c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b9eb38-43d7-4972-af6a-81e86b70f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:04 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Volume db578dab-a87c-496b-adec-916d03add892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db578dab-a87c-496b-adec-916d03add892', 'volume_size': 2} Sep 05 20:57:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:14 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=51,cinder:INSERT=20,cinder:UPDATE=70,cinder:DELETE=6 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:57:14 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=62,cinder:SELECT=62,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Flow 'volume_create_manager' (b20aee88-dfdc-480a-8b4a-42c42394ba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe50cda-a3b0-489c-87ec-4e575e277b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe50cda-a3b0-489c-87ec-4e575e277b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-831808870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1149c019-424e-439c-b1f4-23df3cbdaa48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc00708160b1473c9e770d962c4a5d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:20Z,use_quota=True,user_id='68ecc35db947455aa2edd03e7b6a44e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83f0f3b-f8e9-4099-aba4-b528f90af687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83f0f3b-f8e9-4099-aba4-b528f90af687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00e935c-5c7c-4724-8be5-1764f22a1f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00e935c-5c7c-4724-8be5-1764f22a1f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1149c019-424e-439c-b1f4-23df3cbdaa48', 'volume_name': 'volume-1149c019-424e-439c-b1f4-23df3cbdaa48', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaac1b6d-c375-47f3-b3fc-2a2635638cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaac1b6d-c375-47f3-b3fc-2a2635638cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7700f3f-58c9-456d-89c4-ce6edcd06acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:20 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Volume 1149c019-424e-439c-b1f4-23df3cbdaa48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1149c019-424e-439c-b1f4-23df3cbdaa48', 'volume_size': 1} Sep 05 20:57:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.826s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Uploaded volume to glance image-id: 45fa7a61-f729-4b7b-8eb4-0a1e35d19809. {{(pid=87802) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.386s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-874554948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098c9a15-db94-4b6f-86ee-0f2f7ed7531e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25762c088bb481ca12afb914e009798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:54Z,use_quota=True,user_id='94787724bb4449fea12cc858f95afd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Creating volume 098c9a15-db94-4b6f-86ee-0f2f7ed7531e {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:57:22 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:22 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e 1073741824 Sep 05 20:57:22 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:22 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d64214f1-4717-4c89-b876-f0b02a19f2de tempest-VolumesActionsTest-1248288493 None] Copy volume to image completed successfully. Sep 05 20:57:22 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e 1073741824" returned: 0 in 0.450s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:22 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e Sep 05 20:57:22 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:22 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e" returned: 0 in 0.291s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.600s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2025301978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db578dab-a87c-496b-adec-916d03add892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff020cc101cf4041a7f2984a318f6075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:04Z,use_quota=True,user_id='2ce5420d9f054d39a8acacb3a59d7935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Creating volume db578dab-a87c-496b-adec-916d03add892 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:57:22 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 2147483648 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ffc3b7-638c-455f-8b23-8e7f89ae0f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:22 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 2147483648 Sep 05 20:57:22 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a94b15-4a16-430d-a872-bda1d1921743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:22 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Volume volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e (098c9a15-db94-4b6f-86ee-0f2f7ed7531e): created successfully Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a94b15-4a16-430d-a872-bda1d1921743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Flow 'volume_create_manager' (5ebee355-819a-4674-a759-d0e43fc13ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:22 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-078d2be0-e862-4da1-9dd2-413ae7eb8da6 tempest-VolumesListTestJSON-287466932 None] Created volume successfully. Sep 05 20:57:23 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 2147483648" returned: 0 in 0.612s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:23 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 Sep 05 20:57:23 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:23 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892" returned: 0 in 0.326s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.727s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-831808870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1149c019-424e-439c-b1f4-23df3cbdaa48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc00708160b1473c9e770d962c4a5d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:20Z,use_quota=True,user_id='68ecc35db947455aa2edd03e7b6a44e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Creating volume 1149c019-424e-439c-b1f4-23df3cbdaa48 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:57:23 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b9eb38-43d7-4972-af6a-81e86b70f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db578dab-a87c-496b-adec-916d03add892', 'volume_size': 2}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:23 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 1073741824 Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbb29e4-bd40-4249-8573-5729a1ab21a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:23 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Volume volume-db578dab-a87c-496b-adec-916d03add892 (db578dab-a87c-496b-adec-916d03add892): created successfully Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbb29e4-bd40-4249-8573-5729a1ab21a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Flow 'volume_create_manager' (7da5eeb6-86e3-4315-93ce-9ddedc06d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-5b679c50-153e-484b-906b-b733729cc929 tempest-VolumesCloneNegativeTest-1927668963 None] Created volume successfully. Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:24 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 1073741824" returned: 0 in 0.589s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:24 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 Sep 05 20:57:24 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Acquiring lock "cinder-db578dab-a87c-496b-adec-916d03add892-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "cinder-db578dab-a87c-496b-adec-916d03add892-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Acquiring lock "cinder-quobyte-db578dab-a87c-496b-adec-916d03add892" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:24 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "cinder-quobyte-db578dab-a87c-496b-adec-916d03add892" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.561s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7700f3f-58c9-456d-89c4-ce6edcd06acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1149c019-424e-439c-b1f4-23df3cbdaa48', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b9e760-3c0a-4543-8e47-76cc61f1a1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7a738f-cd7b-4fb6-b19a-b17a9cfde92d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[483ef351-2be9-48ec-971b-1822693fb3b8]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Volume volume-1149c019-424e-439c-b1f4-23df3cbdaa48 (1149c019-424e-439c-b1f4-23df3cbdaa48): created successfully Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b9e760-3c0a-4543-8e47-76cc61f1a1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Flow 'volume_create_manager' (b20aee88-dfdc-480a-8b4a-42c42394ba93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:24 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2aeac129-d27d-44d3-ab1d-f39aa956ace1 tempest-AttachVolumeTestJSON-265975819 None] Created volume successfully. Sep 05 20:57:25 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:57:25 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:25 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 Sep 05 20:57:25 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:25 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.423s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:25 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892" returned: 0 in 0.424s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3641519d-55a7-4189-8862-6a49b8f752be]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:25 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892 Sep 05 20:57:25 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:25 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:57:25 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:25 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-db578dab-a87c-496b-adec-916d03add892" returned: 0 in 0.311s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "cinder-quobyte-db578dab-a87c-496b-adec-916d03add892" released by "delete_volume" :: held 0.816s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Created reservations ['4a9ddbbd-c496-4a5e-b2fa-e0ecdc553424', '6777f83a-c61b-476f-adc8-d41d433d2d84', '901e3b6f-effb-4487-aaac-b89af1e6bae1', 'f27afc93-c8b2-472c-80b1-b20074306a6d'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:25 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.500s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:25 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img Sep 05 20:57:25 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:25 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:25 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "cinder-098c9a15-db94-4b6f-86ee-0f2f7ed7531e-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-098c9a15-db94-4b6f-86ee-0f2f7ed7531e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "cinder-quobyte-098c9a15-db94-4b6f-86ee-0f2f7ed7531e" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-quobyte-098c9a15-db94-4b6f-86ee-0f2f7ed7531e" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec3d562-5bb8-4ac9-8389-0a1a754ba688]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:26 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.391s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Deleted volume successfully. Sep 05 20:57:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f0564ee-6afe-42a0-8cd4-61606a7cb6c9 tempest-VolumesCloneNegativeTest-1927668963 None] Lock "cinder-db578dab-a87c-496b-adec-916d03add892-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:26 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e Sep 05 20:57:26 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:27 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e" returned: 0 in 1.064s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:27 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e Sep 05 20:57:27 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:27 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-098c9a15-db94-4b6f-86ee-0f2f7ed7531e" returned: 0 in 0.704s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-quobyte-098c9a15-db94-4b6f-86ee-0f2f7ed7531e" released by "delete_volume" :: held 1.842s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Created reservations ['ff9092b6-465a-4a77-871d-b7c7cdbb71d0', '3d2967e2-f07a-428a-9c88-62ca9d6b7c73', '9ef37d4c-b47d-4571-903b-46ab8418406c', '6fc82994-c90b-4acb-9d0f-881f9c0d3dba'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:28 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:28 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "cinder-e896dd58-f1a7-4bff-938e-d6550f165e74-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f77e130d-77fa-44a7-85c8-531f7712df16 req-73ee5588-ff70-4183-8374-1f3a5bee207f tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-e896dd58-f1a7-4bff-938e-d6550f165e74-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "cinder-quobyte-e896dd58-f1a7-4bff-938e-d6550f165e74" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-quobyte-e896dd58-f1a7-4bff-938e-d6550f165e74" acquired by "delete_volume" :: waited 0.045s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:29 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ad6775-0ca4-4a69-8257-293fe270057d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:29 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 Sep 05 20:57:29 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:29 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 1.185s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:29 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Deleted volume successfully. Sep 05 20:57:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-59248e81-dfbe-4bc9-a30f-2c382cacb500 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-098c9a15-db94-4b6f-86ee-0f2f7ed7531e-delete_volume" released by "delete_volume" :: held 3.815s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:30 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74" returned: 0 in 0.786s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:30 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74 Sep 05 20:57:30 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:30 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e896dd58-f1a7-4bff-938e-d6550f165e74" returned: 0 in 0.595s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-quobyte-e896dd58-f1a7-4bff-938e-d6550f165e74" released by "delete_volume" :: held 1.528s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Created reservations ['530ffcb1-d29c-4780-a03d-bbbbad2b51a7', '1f77ac25-e632-4dee-845d-07a3aebb388f', '27d3c09f-2691-4264-8ea1-73e0007505cc', '3432ee6c-d19c-40f2-a9a5-28d582e47e13'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:31 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:31 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "cinder-c57b0644-1a17-4812-89c3-fe71894b271d-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-c57b0644-1a17-4812-89c3-fe71894b271d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "cinder-quobyte-c57b0644-1a17-4812-89c3-fe71894b271d" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-quobyte-c57b0644-1a17-4812-89c3-fe71894b271d" acquired by "delete_volume" :: waited 0.070s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cc1e9c-fb12-409d-af74-41fcd32a38da]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:32 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d Sep 05 20:57:32 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:32 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img" returned: 0 in 6.358s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1314140e-9283-4c7f-8150-bcaaceaed0c4]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:32 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.957s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Deleted volume successfully. Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-73512ad9-a80a-4aaa-8f6d-9bf58b57fdb0 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-e896dd58-f1a7-4bff-938e-d6550f165e74-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:32 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:57:32 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:32 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d" returned: 0 in 0.558s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:32 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d Sep 05 20:57:32 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:32 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c57b0644-1a17-4812-89c3-fe71894b271d" returned: 0 in 0.249s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-quobyte-c57b0644-1a17-4812-89c3-fe71894b271d" released by "delete_volume" :: held 0.934s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Created reservations ['ccd4b3f3-85df-4513-9498-4fd323ea989d', '1ddfe78b-cc9c-4c67-8e3a-3d491cbe793e', 'e1a8c366-e4e6-453b-a6a8-905958ba13f9', '31b149ba-bd54-466a-897a-5fd74b0d09fc'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:32 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.660s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:57:32 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Converted 1024.00 MB image at 161.02 MB/s Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] a274dc09-d4bc-4d98-8586-e21924175b55 was raw, converting to qcow2 {{(pid=87802) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 05 20:57:32 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:32 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[955a2627-be94-4a57-a18c-2c472b931559]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:33 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img Sep 05 20:57:33 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:33 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.327s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:33 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:33 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Deleted volume successfully. Sep 05 20:57:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6480c0a2-3a22-414e-a74d-2beddd707744 tempest-VolumesListTestJSON-287466932 None] Lock "cinder-c57b0644-1a17-4812-89c3-fe71894b271d-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:33 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img" returned: 0 in 0.354s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:33 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img Sep 05 20:57:33 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:33 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img" returned: 1 in 0.402s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:57:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img /opt/stack/data/cinder/conversion/vol_upload_8iwrmr5d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:33 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img /opt/stack/data/cinder/conversion/vol_upload_8iwrmr5d Sep 05 20:57:33 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:34 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img /opt/stack/data/cinder/conversion/vol_upload_8iwrmr5d" returned: 0 in 0.293s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:34 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Image conversion details: src /opt/stack/data/cinder/conversion/ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b.temp_image.a274dc09-d4bc-4d98-8586-e21924175b55k0qzluvg.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8iwrmr5d {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:57:34 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 05 20:57:34 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9d26d2-af1b-4df8-9f54-3cdadcc2a6b9]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8iwrmr5d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:34 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8iwrmr5d Sep 05 20:57:34 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:34 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8iwrmr5d" returned: 0 in 0.379s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.587s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Uploaded volume to glance image-id: a274dc09-d4bc-4d98-8586-e21924175b55. {{(pid=87802) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 20:57:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f77e130d-77fa-44a7-85c8-531f7712df16 req-73ee5588-ff70-4183-8374-1f3a5bee207f tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.539s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f77e130d-77fa-44a7-85c8-531f7712df16 req-73ee5588-ff70-4183-8374-1f3a5bee207f tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:36 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-253d96e0-a18c-4534-b6b7-4145962facf2 tempest-VolumesActionsTest-1248288493 None] Copy volume to image completed successfully. Sep 05 20:57:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-f77e130d-77fa-44a7-85c8-531f7712df16 req-73ee5588-ff70-4183-8374-1f3a5bee207f tempest-AttachVolumeTestJSON-265975819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-1149c019-424e-439c-b1f4-23df3cbdaa48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e896904-2785-492f-80b4-6d2db003c46b', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:57:36 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-f77e130d-77fa-44a7-85c8-531f7712df16 req-73ee5588-ff70-4183-8374-1f3a5bee207f tempest-AttachVolumeTestJSON-265975819 None] attachment_update completed successfully. Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Acquiring lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Acquiring lock "cinder-quobyte-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Lock "cinder-quobyte-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[020fe774-c185-4495-95fe-815a9fdf876a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:38 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:57:38 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Flow 'volume_create_manager' (44d81586-240d-420f-8327-5b65bf24380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae22b6c-c2c5-4a2e-86e1-26c2c9203e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae22b6c-c2c5-4a2e-86e1-26c2c9203e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1619964034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e80277f-1983-4123-9e74-91e1863ce3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7994f7d927a46a18dc9c7c96451638d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:39Z,use_quota=True,user_id='7cd0857654b646c39a41963e0785d2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fd3ed9-bce3-487c-92c9-1e784cf7994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fd3ed9-bce3-487c-92c9-1e784cf7994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8c3ba0-b152-4ea6-9e0b-4c8a1d750916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8c3ba0-b152-4ea6-9e0b-4c8a1d750916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e80277f-1983-4123-9e74-91e1863ce3e4', 'volume_name': 'volume-7e80277f-1983-4123-9e74-91e1863ce3e4', 'volume_size': 2}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4681ee98-1be6-4b85-9aa3-d68f0d64b6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4681ee98-1be6-4b85-9aa3-d68f0d64b6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0224702d-3b01-4359-9381-80af206b7c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:38 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Volume 7e80277f-1983-4123-9e74-91e1863ce3e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e80277f-1983-4123-9e74-91e1863ce3e4', 'volume_size': 2} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1619964034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e80277f-1983-4123-9e74-91e1863ce3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7994f7d927a46a18dc9c7c96451638d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:39Z,use_quota=True,user_id='7cd0857654b646c39a41963e0785d2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Creating volume 7e80277f-1983-4123-9e74-91e1863ce3e4 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:57:38 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 2147483648 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:38 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 2147483648 Sep 05 20:57:38 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:38 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.529s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:38 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b Sep 05 20:57:38 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:39 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" returned: 0 in 0.319s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Lock "cinder-quobyte-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b" released by "delete_volume" :: held 0.910s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Created reservations ['deaee0ef-ac32-4acc-a99f-fa0efe76395a', '0c922104-7bba-4362-b4ab-d12ad40ae921', '1d956b20-7985-4c26-9e6e-9769be26c43d', 'b02dbccf-7093-4f7d-b349-dcaf50ed01b0'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:39 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 2147483648" returned: 0 in 0.655s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:39 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:39 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Flow 'volume_create_manager' (c6638a31-397b-4440-8f17-1b98acba8adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ab9dc3-0990-496c-952e-e7327111908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ab9dc3-0990-496c-952e-e7327111908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-775306291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd94f07-5270-4fb2-bbaf-a17b3363edd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc00708160b1473c9e770d962c4a5d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:39Z,use_quota=True,user_id='68ecc35db947455aa2edd03e7b6a44e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3fd0c4-c86c-4c26-8031-293e6d57d4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3fd0c4-c86c-4c26-8031-293e6d57d4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6e33d1-fc9a-43d1-9458-be7efc5ba713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6e33d1-fc9a-43d1-9458-be7efc5ba713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd94f07-5270-4fb2-bbaf-a17b3363edd9', 'volume_name': 'volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d484e57e-0927-4708-af91-c7aafeae6fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d484e57e-0927-4708-af91-c7aafeae6fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327e57d9-8c5d-4248-913b-d198277f4997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:39 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Volume ccd94f07-5270-4fb2-bbaf-a17b3363edd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9', 'volume_size': 1} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:39 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 Sep 05 20:57:39 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:39 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.318s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Deleted volume successfully. Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75116f6c-c5d2-4f83-a6fd-2b37a258d784 tempest-VolumesActionsTest-1248288493 None] Lock "cinder-ae0258a4-9f8c-4521-aeb2-15c2b9fbc59b-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:39 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4" returned: 0 in 0.317s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-775306291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd94f07-5270-4fb2-bbaf-a17b3363edd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc00708160b1473c9e770d962c4a5d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:39Z,use_quota=True,user_id='68ecc35db947455aa2edd03e7b6a44e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Creating volume ccd94f07-5270-4fb2-bbaf-a17b3363edd9 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:57:39 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0224702d-3b01-4359-9381-80af206b7c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e80277f-1983-4123-9e74-91e1863ce3e4', 'volume_size': 2}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:39 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 1073741824 Sep 05 20:57:39 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1c04f4-f29b-47e4-87e0-c95a1ea7eb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:39 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Volume volume-7e80277f-1983-4123-9e74-91e1863ce3e4 (7e80277f-1983-4123-9e74-91e1863ce3e4): created successfully Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1c04f4-f29b-47e4-87e0-c95a1ea7eb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Flow 'volume_create_manager' (44d81586-240d-420f-8327-5b65bf24380c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3c03aea7-99fe-41cc-b935-0f2953b4bedf tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Created volume successfully. Sep 05 20:57:40 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 1073741824" returned: 0 in 0.683s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:40 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 Sep 05 20:57:40 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:41 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9" returned: 0 in 0.433s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.045s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Creating offline snapshot d030747a-55c3-473c-8f10-e37b461226f1 of volume 7e80277f-1983-4123-9e74-91e1863ce3e4 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327e57d9-8c5d-4248-913b-d198277f4997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2672cf2-9c4c-4f80-b5b2-4be10dd61eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ccf07-3a63-45e9-95f9-48f908143b60]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Volume volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 (ccd94f07-5270-4fb2-bbaf-a17b3363edd9): created successfully Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2672cf2-9c4c-4f80-b5b2-4be10dd61eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Flow 'volume_create_manager' (c6638a31-397b-4440-8f17-1b98acba8adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-01ca5074-1b7b-4859-a2b9-e16a189e4052 tempest-AttachVolumeTestJSON-265975819 None] Created volume successfully. Sep 05 20:57:41 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 Sep 05 20:57:41 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:41 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4" returned: 0 in 0.492s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 2G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:41 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 2G Sep 05 20:57:41 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:42 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 2G" returned: 0 in 0.638s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e80277f-1983-4123-9e74-91e1863ce3e4 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:42 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e80277f-1983-4123-9e74-91e1863ce3e4 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 Sep 05 20:57:42 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:42 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e80277f-1983-4123-9e74-91e1863ce3e4 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1" returned: 0 in 0.481s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:42 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 is being set with open permissions: ugo+rw Sep 05 20:57:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:42 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 Sep 05 20:57:42 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c9a2ebe4-8a05-4de1-b67d-30725756b331 req-8eeddbaa-f303-411e-8067-4fcd3ec31983 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:43 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1" returned: 0 in 0.333s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:43 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.info Sep 05 20:57:43 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:43 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.info" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:43 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.info is being set with open permissions: ugo+rw Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:43 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.info Sep 05 20:57:43 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:43 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.info" returned: 0 in 0.260s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c9a2ebe4-8a05-4de1-b67d-30725756b331 req-8eeddbaa-f303-411e-8067-4fcd3ec31983 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.832s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c9a2ebe4-8a05-4de1-b67d-30725756b331 req-8eeddbaa-f303-411e-8067-4fcd3ec31983 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bf1e7162-0f32-464a-9703-35dfb54d7d3e tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Create snapshot completed successfully Sep 05 20:57:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-c9a2ebe4-8a05-4de1-b67d-30725756b331 req-8eeddbaa-f303-411e-8067-4fcd3ec31983 tempest-AttachVolumeTestJSON-265975819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c101ae29-e372-4e48-ad65-8c677e39826a', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:57:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-c9a2ebe4-8a05-4de1-b67d-30725756b331 req-8eeddbaa-f303-411e-8067-4fcd3ec31983 tempest-AttachVolumeTestJSON-265975819 None] attachment_update completed successfully. Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "cinder-d030747a-55c3-473c-8f10-e37b461226f1-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-d030747a-55c3-473c-8f10-e37b461226f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "cinder-quobyte-7e80277f-1983-4123-9e74-91e1863ce3e4" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-quobyte-7e80277f-1983-4123-9e74-91e1863ce3e4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "cinder-quobyte-d030747a-55c3-473c-8f10-e37b461226f1" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-quobyte-d030747a-55c3-473c-8f10-e37b461226f1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Deleting offline snapshot d030747a-55c3-473c-8f10-e37b461226f1 of volume 7e80277f-1983-4123-9e74-91e1863ce3e4 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] snapshot_file for this snap is: volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db5fa5c-a3ce-4c7e-a92c-98672f918d73]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:44 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 Sep 05 20:57:44 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:45 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1" returned: 0 in 0.655s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e80277f-1983-4123-9e74-91e1863ce3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:45 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3021bde-66b6-4a90-8364-9a180e396bd7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:45 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 Sep 05 20:57:45 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:45 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4" returned: 0 in 0.576s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:45 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 Sep 05 20:57:45 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:46 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-799861eb-2bca-4df0-968a-03d7f0298637 req-ecfb57d9-cf6f-4432-afaf-0171fce461e5 tempest-AttachVolumeTestJSON-265975819 None] Terminate volume connection completed successfully. Sep 05 20:57:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-799861eb-2bca-4df0-968a-03d7f0298637 req-ecfb57d9-cf6f-4432-afaf-0171fce461e5 tempest-AttachVolumeTestJSON-265975819 None] Deleting attachment 6e896904-2785-492f-80b4-6d2db003c46b. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:57:46 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1" returned: 0 in 0.553s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:46 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1 Sep 05 20:57:46 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:46 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4.d030747a-55c3-473c-8f10-e37b461226f1" returned: 0 in 0.275s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-quobyte-d030747a-55c3-473c-8f10-e37b461226f1" released by "_delete_snapshot" :: held 2.240s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-quobyte-7e80277f-1983-4123-9e74-91e1863ce3e4" released by "delete_snapshot" :: held 2.279s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:46 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Created reservations ['6454dd91-8435-4658-989e-f87601e2515d', 'c7de9876-c85e-4478-a7b1-3f69ea968cb5', '83799319-851c-4a6a-9290-07acd1bbf408', '2d4c36c2-de1c-411e-acb5-77c429ad1355'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:46 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Delete snapshot completed successfully. Sep 05 20:57:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-60630837-59e0-4dd9-a411-dbdeced56fcb tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-d030747a-55c3-473c-8f10-e37b461226f1-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-27146b30-fd52-488e-b99b-155998b73195 req-ebe20fcf-fae5-4337-a061-1c10b929bbf0 tempest-AttachVolumeTestJSON-265975819 None] Terminate volume connection completed successfully. Sep 05 20:57:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-27146b30-fd52-488e-b99b-155998b73195 req-ebe20fcf-fae5-4337-a061-1c10b929bbf0 tempest-AttachVolumeTestJSON-265975819 None] Deleting attachment c101ae29-e372-4e48-ad65-8c677e39826a. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:57:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "cinder-7e80277f-1983-4123-9e74-91e1863ce3e4-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-7e80277f-1983-4123-9e74-91e1863ce3e4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "cinder-quobyte-7e80277f-1983-4123-9e74-91e1863ce3e4" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-quobyte-7e80277f-1983-4123-9e74-91e1863ce3e4" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20d7d6-b3b2-4a93-a681-4a2f9020ec81]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:48 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 Sep 05 20:57:48 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:48 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4" returned: 0 in 0.549s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:48 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4 Sep 05 20:57:48 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:49 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7e80277f-1983-4123-9e74-91e1863ce3e4" returned: 0 in 0.346s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-quobyte-7e80277f-1983-4123-9e74-91e1863ce3e4" released by "delete_volume" :: held 1.010s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Created reservations ['26c96391-da42-4fe6-b59f-cf8ee9e07b25', 'ecc1a7a2-c97f-4a58-8dfb-3d947e008e8f', 'c986e236-2dee-43e3-add6-355c3c7d7b65', '589783ee-6a9c-4d1d-842c-47794b9113fa'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:49 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:49 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:49 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.610s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Deleted volume successfully. Sep 05 20:57:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-4ccdb31b-3c29-4d9b-b4d9-8cb6acf8bc22 tempest-VolumesSnapshotNegativeTestJSON-1855452571 None] Lock "cinder-7e80277f-1983-4123-9e74-91e1863ce3e4-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Flow 'volume_create_manager' (61cb7306-5d14-4f82-a929-982eb27a61ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4f34d6-5f4e-4f5b-b6e8-191b95a046ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4f34d6-5f4e-4f5b-b6e8-191b95a046ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1881717279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3198718-1bb1-450f-baa5-f386e5d59c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8856cebb03438dbb1905c126a0372b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:52Z,use_quota=True,user_id='eaa9019949b344289c76cf8c846f9e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa5f926-8d81-4570-b329-783edf9fdd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa5f926-8d81-4570-b329-783edf9fdd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3555234-a17a-4374-8a7e-c1f2d47e62d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3555234-a17a-4374-8a7e-c1f2d47e62d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3198718-1bb1-450f-baa5-f386e5d59c97', 'volume_name': 'volume-a3198718-1bb1-450f-baa5-f386e5d59c97', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcab912-ac31-4850-a81e-50e6fd8f2953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcab912-ac31-4850-a81e-50e6fd8f2953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e573f4b-6d75-4f98-90bc-09862f2e6f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Volume a3198718-1bb1-450f-baa5-f386e5d59c97: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3198718-1bb1-450f-baa5-f386e5d59c97', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 20:57:52 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Trying to clone a3198718-1bb1-450f-baa5-f386e5d59c97 from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 20:57:53 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 20:57:53 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Image download 20.69 MB at 20.69 MB/s Sep 05 20:57:53 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b700a9-a4b3-4c10-b0c2-d0cd68fcca53]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:53 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD Sep 05 20:57:53 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:53 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:53 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df is fetched for user eaa9019949b344289c76cf8c846f9e16. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 20:57:53 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c12182a-4f7a-463e-b3f2-68c14c3e131c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:54 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD Sep 05 20:57:54 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "cinder-ccd94f07-5270-4fb2-bbaf-a17b3363edd9-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-ccd94f07-5270-4fb2-bbaf-a17b3363edd9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:54 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1881717279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3198718-1bb1-450f-baa5-f386e5d59c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8856cebb03438dbb1905c126a0372b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:52Z,use_quota=True,user_id='eaa9019949b344289c76cf8c846f9e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Creating volume a3198718-1bb1-450f-baa5-f386e5d59c97 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:57:54 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:54 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 1073741824 Sep 05 20:57:54 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "cinder-quobyte-ccd94f07-5270-4fb2-bbaf-a17b3363edd9" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-quobyte-ccd94f07-5270-4fb2-bbaf-a17b3363edd9" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca4f4a0-2626-46ea-b75c-74b464cb8024]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:54 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 Sep 05 20:57:54 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:54 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 1073741824" returned: 0 in 0.553s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9" returned: 0 in 0.510s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:55 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 Sep 05 20:57:55 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9 Sep 05 20:57:55 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:55 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Attempting download of 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume a3198718-1bb1-450f-baa5-f386e5d59c97. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 20:57:55 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ccd94f07-5270-4fb2-bbaf-a17b3363edd9" returned: 0 in 0.464s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-quobyte-ccd94f07-5270-4fb2-bbaf-a17b3363edd9" released by "delete_volume" :: held 1.080s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bc402f-9154-46b4-b606-cc6c257b7340]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_2utx8m9o {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Created reservations ['9f977e09-1f80-4f7c-ab04-d25e740dc32b', 'd89518d2-a13a-4980-82db-9d2e7fc5ca0d', '9ff12cf5-1b51-47ee-a2cd-f07a404d1a35', '6e927f5f-b1fd-4082-91d8-946870e9e267'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:55 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_2utx8m9o Sep 05 20:57:55 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:55 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:55 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:56 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:56 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:56 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_2utx8m9o" returned: 0 in 0.458s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_2utx8m9o {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:56 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.355s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:57:56 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_2utx8m9o Sep 05 20:57:56 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:56 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.387s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Deleted volume successfully. Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bb0d0238-a041-4fda-8e30-60033e06ea87 tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-ccd94f07-5270-4fb2-bbaf-a17b3363edd9-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:56 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_2utx8m9o" returned: 1 in 0.475s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_2utx8m9o' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a951c011-f5ad-440d-99c3-4f1e1e574733]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "cinder-1149c019-424e-439c-b1f4-23df3cbdaa48-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-1149c019-424e-439c-b1f4-23df3cbdaa48-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:56 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD Sep 05 20:57:56 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "cinder-quobyte-1149c019-424e-439c-b1f4-23df3cbdaa48" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-quobyte-1149c019-424e-439c-b1f4-23df3cbdaa48" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a4c91-a68c-44bb-8d04-08fde7f2eda6]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:56 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 Sep 05 20:57:56 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:56 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df was qcow2, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 20:57:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:56 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 Sep 05 20:57:56 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:57 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48" returned: 0 in 0.468s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:57 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48 Sep 05 20:57:57 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:57 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1149c019-424e-439c-b1f4-23df3cbdaa48" returned: 0 in 0.334s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-quobyte-1149c019-424e-439c-b1f4-23df3cbdaa48" released by "delete_volume" :: held 0.863s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Created reservations ['4ef5824e-b8e9-4f08-868c-4449682d5cfa', '7d4194be-0a86-48d8-ae43-bc4bcbf5b413', 'c91ea2f6-87af-4c12-8185-bd9865a815f8', '5728f7c7-2cd5-4d25-afd8-1389f1d028a1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:57 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:57 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "cinder-d5ce12bb-7717-473f-97f4-e2863b670453-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-d5ce12bb-7717-473f-97f4-e2863b670453-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:58 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.349s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:58 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Deleted volume successfully. Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "cinder-quobyte-d5ce12bb-7717-473f-97f4-e2863b670453" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-quobyte-d5ce12bb-7717-473f-97f4-e2863b670453" acquired by "delete_volume" :: waited 0.035s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-af5e13e2-f921-4c35-a51f-9cf35fe2810c tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-1149c019-424e-439c-b1f4-23df3cbdaa48-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f19cd6b-f9b7-4e86-808e-bb1856d28b8b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:58 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 Sep 05 20:57:58 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:58 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453" returned: 0 in 0.441s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:58 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453 Sep 05 20:57:58 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:59 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d5ce12bb-7717-473f-97f4-e2863b670453" returned: 0 in 0.351s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-quobyte-d5ce12bb-7717-473f-97f4-e2863b670453" released by "delete_volume" :: held 0.888s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Created reservations ['d10767c3-882d-4c96-a67a-f32edddeed8a', '1b82343c-0049-45be-9dc7-2d38152538cc', '3eb93c90-6d50-4d71-b60d-ae16f7022cb2', '1875def9-f8ef-41b2-8275-0904f01fb3a9'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:59 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:57:59 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:59 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.319s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Deleted volume successfully. Sep 05 20:57:59 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97" returned: 0 in 2.717s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_8nuzzd3ldevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:57:59 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Converted 112.00 MB image at 41.22 MB/s Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-005cf8fc-d68c-4347-8474-172b9fa1e835 tempest-AttachVolumeTestJSON-265975819 None] Lock "cinder-d5ce12bb-7717-473f-97f4-e2863b670453-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:59 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 1G Sep 05 20:57:59 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:00 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 1G" returned: 0 in 0.374s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Downloaded image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume a3198718-1bb1-450f-baa5-f386e5d59c97 successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df for user eaa9019949b344289c76cf8c846f9e16 is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Marking volume a3198718-1bb1-450f-baa5-f386e5d59c97 as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Copying metadata from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df to a3198718-1bb1-450f-baa5-f386e5d59c97. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Creating volume glance metadata for volume a3198718-1bb1-450f-baa5-f386e5d59c97 backed by image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e573f4b-6d75-4f98-90bc-09862f2e6f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3198718-1bb1-450f-baa5-f386e5d59c97', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12667a51-89ce-4b06-a04f-5b6dbafd40cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:00 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Volume volume-a3198718-1bb1-450f-baa5-f386e5d59c97 (a3198718-1bb1-450f-baa5-f386e5d59c97): created successfully Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12667a51-89ce-4b06-a04f-5b6dbafd40cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Flow 'volume_create_manager' (61cb7306-5d14-4f82-a929-982eb27a61ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a6b6c04d-d6c8-406c-8314-26c69d9d9818 tempest-VolumesExtendTest-1434929979 None] Created volume successfully. Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a519abc4-b38d-4fc4-b617-4fe2954cafba tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a519abc4-b38d-4fc4-b617-4fe2954cafba tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e463f57-5176-4524-8218-8fbdfbba1e65]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a519abc4-b38d-4fc4-b617-4fe2954cafba tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:01 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 Sep 05 20:58:01 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:01 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a519abc4-b38d-4fc4-b617-4fe2954cafba tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97" returned: 0 in 0.479s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a519abc4-b38d-4fc4-b617-4fe2954cafba tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 2G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a519abc4-b38d-4fc4-b617-4fe2954cafba tempest-VolumesExtendTest-1434929979 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 2G" returned: 0 in 0.140s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a519abc4-b38d-4fc4-b617-4fe2954cafba tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.649s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:01 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a519abc4-b38d-4fc4-b617-4fe2954cafba tempest-VolumesExtendTest-1434929979 None] Extend volume completed successfully. Sep 05 20:58:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "cinder-a3198718-1bb1-450f-baa5-f386e5d59c97-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-a3198718-1bb1-450f-baa5-f386e5d59c97-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "cinder-quobyte-a3198718-1bb1-450f-baa5-f386e5d59c97" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-quobyte-a3198718-1bb1-450f-baa5-f386e5d59c97" acquired by "delete_volume" :: waited 0.045s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b6679-4462-4b5f-b90a-7a6d06a8906b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:02 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 Sep 05 20:58:02 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:03 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97" returned: 0 in 0.526s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:03 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97 Sep 05 20:58:03 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:03 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3198718-1bb1-450f-baa5-f386e5d59c97" returned: 0 in 0.505s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-quobyte-a3198718-1bb1-450f-baa5-f386e5d59c97" released by "delete_volume" :: held 1.134s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Created reservations ['4920c4e2-72dc-4465-94f1-115101fd625c', 'cfcebbd1-8d5e-4e6d-b521-17a408446709', '9cb25a2e-a9d1-4513-ad72-b8b0d3d986c0', 'abaef0ef-f4ff-4aa7-b9b8-97a8f15fdf5a'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:04 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:58:04 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:04 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.296s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:04 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:04 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Deleted volume successfully. Sep 05 20:58:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ea82c66f-deaf-40a3-b8f8-dee5a91f1ae9 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-a3198718-1bb1-450f-baa5-f386e5d59c97-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Flow 'volume_create_manager' (368a50bc-3243-460c-8be4-f58948b05235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8970e6-a8b3-43f2-94aa-5b17cb7e54b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8970e6-a8b3-43f2-94aa-5b17cb7e54b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1297850820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d98f3c-3866-411f-bee2-05e46037ced5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8856cebb03438dbb1905c126a0372b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:06Z,use_quota=True,user_id='eaa9019949b344289c76cf8c846f9e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d827850b-6d4e-4c38-b7b1-36518765d27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d827850b-6d4e-4c38-b7b1-36518765d27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a05ea6-3077-4866-8dfb-b0039cb08bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a05ea6-3077-4866-8dfb-b0039cb08bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d98f3c-3866-411f-bee2-05e46037ced5', 'volume_name': 'volume-03d98f3c-3866-411f-bee2-05e46037ced5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9276ba-43bb-4733-a53c-a16998c88c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9276ba-43bb-4733-a53c-a16998c88c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4fe3517-5df3-4aa5-91b6-bcfe44e9777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:05 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Volume 03d98f3c-3866-411f-bee2-05e46037ced5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d98f3c-3866-411f-bee2-05e46037ced5', 'volume_size': 1} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1297850820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d98f3c-3866-411f-bee2-05e46037ced5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8856cebb03438dbb1905c126a0372b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:06Z,use_quota=True,user_id='eaa9019949b344289c76cf8c846f9e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Creating volume 03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:58:05 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:58:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:05 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 1073741824 Sep 05 20:58:05 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:06 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 1073741824" returned: 0 in 0.540s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:06 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 Sep 05 20:58:06 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:06 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5" returned: 0 in 0.300s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4fe3517-5df3-4aa5-91b6-bcfe44e9777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d98f3c-3866-411f-bee2-05e46037ced5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1eba4f-2b52-4120-81a9-8aaa8629ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:06 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Volume volume-03d98f3c-3866-411f-bee2-05e46037ced5 (03d98f3c-3866-411f-bee2-05e46037ced5): created successfully Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1eba4f-2b52-4120-81a9-8aaa8629ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Flow 'volume_create_manager' (368a50bc-3243-460c-8be4-f58948b05235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:06 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1f93b6e7-ab6d-4945-88da-91b04f0df674 tempest-VolumesExtendTest-1434929979 None] Created volume successfully. Sep 05 20:58:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Creating offline snapshot 5f8d5a7f-2e78-4d18-88e1-8c49cb099643 of volume 03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:58:07 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7762969d-ccde-4682-8a51-9af1673d10fc]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:08 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 Sep 05 20:58:08 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:08 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5" returned: 0 in 0.564s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:08 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 1G Sep 05 20:58:08 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:09 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 1G" returned: 0 in 0.623s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d98f3c-3866-411f-bee2-05e46037ced5 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:09 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d98f3c-3866-411f-bee2-05e46037ced5 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 Sep 05 20:58:09 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:09 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d98f3c-3866-411f-bee2-05e46037ced5 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643" returned: 0 in 0.540s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:09 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 is being set with open permissions: ugo+rw Sep 05 20:58:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:09 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 Sep 05 20:58:09 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:10 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643" returned: 0 in 0.397s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:10 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.info Sep 05 20:58:10 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:10 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.info" returned: 0 in 0.408s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:10 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.info is being set with open permissions: ugo+rw Sep 05 20:58:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:10 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.info Sep 05 20:58:10 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:10 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.info" returned: 0 in 0.428s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:11 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0fcbde52-a3ce-473e-810d-06ccef8c21a8 tempest-VolumesExtendTest-1434929979 None] Create snapshot completed successfully Sep 05 20:58:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-686fd95f-aa26-4b53-b50b-a7060609e77b tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-686fd95f-aa26-4b53-b50b-a7060609e77b tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e709c167-d5d8-4453-82a8-806340c9a571]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-686fd95f-aa26-4b53-b50b-a7060609e77b tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:12 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 Sep 05 20:58:12 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:13 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-686fd95f-aa26-4b53-b50b-a7060609e77b tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5" returned: 0 in 0.510s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-686fd95f-aa26-4b53-b50b-a7060609e77b tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 2G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-686fd95f-aa26-4b53-b50b-a7060609e77b tempest-VolumesExtendTest-1434929979 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 2G" returned: 0 in 0.236s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-686fd95f-aa26-4b53-b50b-a7060609e77b tempest-VolumesExtendTest-1434929979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.822s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:13 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-686fd95f-aa26-4b53-b50b-a7060609e77b tempest-VolumesExtendTest-1434929979 None] Extend volume completed successfully. Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "cinder-5f8d5a7f-2e78-4d18-88e1-8c49cb099643-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-5f8d5a7f-2e78-4d18-88e1-8c49cb099643-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "cinder-quobyte-03d98f3c-3866-411f-bee2-05e46037ced5" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-quobyte-03d98f3c-3866-411f-bee2-05e46037ced5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "cinder-quobyte-5f8d5a7f-2e78-4d18-88e1-8c49cb099643" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-quobyte-5f8d5a7f-2e78-4d18-88e1-8c49cb099643" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Deleting offline snapshot 5f8d5a7f-2e78-4d18-88e1-8c49cb099643 of volume 03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] snapshot_file for this snap is: volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-893116a4-cedc-4f32-8665-3e5104a729a5 tempest-BackendsCapabilitiesAdminTestsJSON-1938054748 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.672607421875, 'free_capacity_gb': 1773.672607421875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87802) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8723e9a-0fce-4783-9b66-5ce302f8aca1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75df949a-53d5-4faf-b500-0e66edffe99b tempest-BackendsCapabilitiesAdminTestsJSON-1938054748 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.672607421875, 'free_capacity_gb': 1773.672607421875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87802) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 20:58:14 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 Sep 05 20:58:14 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:14 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643" returned: 0 in 0.541s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d98f3c-3866-411f-bee2-05e46037ced5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de5c896-5c1e-4275-8302-995d1026c03a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:15 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 Sep 05 20:58:15 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:15 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5" returned: 0 in 0.538s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:15 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 Sep 05 20:58:15 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:16 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643" returned: 0 in 0.611s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:16 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643 Sep 05 20:58:16 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:16 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5.5f8d5a7f-2e78-4d18-88e1-8c49cb099643" returned: 0 in 0.311s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=124,cinder:INSERT=36,cinder:SELECT=99,cinder:DELETE=11 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=108,cinder:UPDATE=114,cinder:DELETE=8,cinder:INSERT=30 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-quobyte-5f8d5a7f-2e78-4d18-88e1-8c49cb099643" released by "_delete_snapshot" :: held 2.242s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-quobyte-03d98f3c-3866-411f-bee2-05e46037ced5" released by "delete_snapshot" :: held 2.297s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Created reservations ['451db381-00d0-41b8-82a0-ce4e1066d751', '8551c233-acd6-454c-83b1-aba053e095cf', '62ca193b-2f13-46cf-9562-44b781cd3f21', '7f1c1180-f768-46e4-ae0d-674bff342f91'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Delete snapshot completed successfully. Sep 05 20:58:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0caf38db-4568-4949-b16e-c61b538a26b6 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-5f8d5a7f-2e78-4d18-88e1-8c49cb099643-delete_snapshot" released by "delete_snapshot" :: held 2.489s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "cinder-03d98f3c-3866-411f-bee2-05e46037ced5-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-03d98f3c-3866-411f-bee2-05e46037ced5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "cinder-quobyte-03d98f3c-3866-411f-bee2-05e46037ced5" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-quobyte-03d98f3c-3866-411f-bee2-05e46037ced5" acquired by "delete_volume" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:17 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8dd69b-1648-4007-b2d0-e878e5c9812c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:18 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 Sep 05 20:58:18 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:18 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5" returned: 0 in 0.597s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:18 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5 Sep 05 20:58:18 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:18 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-03d98f3c-3866-411f-bee2-05e46037ced5" returned: 0 in 0.450s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-quobyte-03d98f3c-3866-411f-bee2-05e46037ced5" released by "delete_volume" :: held 1.194s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Created reservations ['5eae157d-8d04-4315-abd1-7e4f00d66495', '4937040e-432b-4d1c-b39e-b39ae3e8f5a8', '194aa060-32d1-4c08-a7ae-27ebefa8cb6f', '74555e52-af47-41be-83a1-8caeb17a9687'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:19 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:58:19 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:19 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.616s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Deleted volume successfully. Sep 05 20:58:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fdc8a485-3f1a-43b9-9006-86e50e205e93 tempest-VolumesExtendTest-1434929979 None] Lock "cinder-03d98f3c-3866-411f-bee2-05e46037ced5-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Flow 'volume_create_manager' (6910bf99-318c-46ca-ae04-36e07aae4ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b130aaa-4b13-407e-a0f2-d17d2523ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b130aaa-4b13-407e-a0f2-d17d2523ecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1133007750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbdeebf-671f-4661-8db4-1a4b4390bd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f152c0463fe5460a989bf617b0e42986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:26Z,use_quota=True,user_id='dba21e20178a4d49a0b484bd2c76216e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e2b8de-58f5-4d18-93c5-d7d42a10a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e2b8de-58f5-4d18-93c5-d7d42a10a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1906e4-13d1-4950-9db2-f173dd3c46c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1906e4-13d1-4950-9db2-f173dd3c46c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbdeebf-671f-4661-8db4-1a4b4390bd7b', 'volume_name': 'volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb90045-d852-482a-824f-bc6dd0123c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb90045-d852-482a-824f-bc6dd0123c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4083cd-20ca-464b-ac0e-ef9ef2889d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:25 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Volume 3bbdeebf-671f-4661-8db4-1a4b4390bd7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b', 'volume_size': 1} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1133007750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbdeebf-671f-4661-8db4-1a4b4390bd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f152c0463fe5460a989bf617b0e42986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:26Z,use_quota=True,user_id='dba21e20178a4d49a0b484bd2c76216e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Creating volume 3bbdeebf-671f-4661-8db4-1a4b4390bd7b {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:58:25 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:58:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:25 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b 1073741824 Sep 05 20:58:25 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:26 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b 1073741824" returned: 0 in 0.985s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:26 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b Sep 05 20:58:26 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:27 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b" returned: 0 in 0.495s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4083cd-20ca-464b-ac0e-ef9ef2889d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b326c55-021d-4ce3-8b80-a2e3ea35b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:27 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Volume volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b (3bbdeebf-671f-4661-8db4-1a4b4390bd7b): created successfully Sep 05 20:58:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b326c55-021d-4ce3-8b80-a2e3ea35b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Flow 'volume_create_manager' (6910bf99-318c-46ca-ae04-36e07aae4ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-25ac17bd-d54f-4201-8082-aab811052d8f tempest-TestMinimumBasicScenario-1196548303 None] Created volume successfully. Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Flow 'volume_create_manager' (c11e4d17-1604-4b91-8974-5c7348cec37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e050f4d5-f8cb-4551-ad01-9c3fad3f3ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e050f4d5-f8cb-4551-ad01-9c3fad3f3ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-625877579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b342702-8032-447f-8d8d-d7a5ee066640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4273e448264b1da3b1970cb0d55fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:28Z,use_quota=True,user_id='25f79e5b117445709a8541e97d348a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b7d00f-ca8f-44dc-a9f2-38ab03ebecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b7d00f-ca8f-44dc-a9f2-38ab03ebecd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cff9fb-46ec-483c-935d-b91647990efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cff9fb-46ec-483c-935d-b91647990efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b342702-8032-447f-8d8d-d7a5ee066640', 'volume_name': 'volume-7b342702-8032-447f-8d8d-d7a5ee066640', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7201b264-e5a4-4aa1-b7d7-b1c402054685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7201b264-e5a4-4aa1-b7d7-b1c402054685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a914786-8099-4a41-8740-a3bdc7d263f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:28 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Volume 7b342702-8032-447f-8d8d-d7a5ee066640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b342702-8032-447f-8d8d-d7a5ee066640', 'volume_size': 1} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-625877579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b342702-8032-447f-8d8d-d7a5ee066640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4273e448264b1da3b1970cb0d55fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:28Z,use_quota=True,user_id='25f79e5b117445709a8541e97d348a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Creating volume 7b342702-8032-447f-8d8d-d7a5ee066640 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:58:28 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:58:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:28 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 1073741824 Sep 05 20:58:28 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:29 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 1073741824" returned: 0 in 0.830s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-0ab6f161-f241-474b-aa94-032aa14008aa req-67d6a5f2-68b1-4a98-afba-c908ae95173b tempest-TestMinimumBasicScenario-1196548303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:29 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 Sep 05 20:58:29 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:29 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640" returned: 0 in 0.360s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-0ab6f161-f241-474b-aa94-032aa14008aa req-67d6a5f2-68b1-4a98-afba-c908ae95173b tempest-TestMinimumBasicScenario-1196548303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.438s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a914786-8099-4a41-8740-a3bdc7d263f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b342702-8032-447f-8d8d-d7a5ee066640', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2e2284-2f8f-492d-b300-546517d83c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-0ab6f161-f241-474b-aa94-032aa14008aa req-67d6a5f2-68b1-4a98-afba-c908ae95173b tempest-TestMinimumBasicScenario-1196548303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:29 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Volume volume-7b342702-8032-447f-8d8d-d7a5ee066640 (7b342702-8032-447f-8d8d-d7a5ee066640): created successfully Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2e2284-2f8f-492d-b300-546517d83c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Flow 'volume_create_manager' (c11e4d17-1604-4b91-8974-5c7348cec37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-338a54dd-8244-4b7f-91ce-2296fee11030 tempest-VolumesNegativeTest-1117677061 None] Created volume successfully. Sep 05 20:58:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-0ab6f161-f241-474b-aa94-032aa14008aa req-67d6a5f2-68b1-4a98-afba-c908ae95173b tempest-TestMinimumBasicScenario-1196548303 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfa44ac8-4726-4ef1-bb76-aa0070aca1c1', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:58:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-0ab6f161-f241-474b-aa94-032aa14008aa req-67d6a5f2-68b1-4a98-afba-c908ae95173b tempest-TestMinimumBasicScenario-1196548303 None] attachment_update completed successfully. Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Flow 'volume_create_manager' (b88d2276-1f09-4c5f-b764-edd6f53b13b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80db5847-f7fd-4de4-b90b-847569f27e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80db5847-f7fd-4de4-b90b-847569f27e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1447105925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b804a284-760d-44b1-be97-bc3f2017b741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d4b8b5441949fe9a18444ed33f0ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:37Z,use_quota=True,user_id='fcd94b635f1c446b9a5045b15daef45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(289ba013-9509-417b-adf2-2b9201f4ebb1),volume_type_id=289ba013-9509-417b-adf2-2b9201f4ebb1)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29001cce-2f23-44cf-861c-406f6ee51c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29001cce-2f23-44cf-861c-406f6ee51c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e48007-5a5b-4dc1-bc67-4e149bd063a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e48007-5a5b-4dc1-bc67-4e149bd063a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b804a284-760d-44b1-be97-bc3f2017b741', 'volume_name': 'volume-b804a284-760d-44b1-be97-bc3f2017b741', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6698fae8-1efa-42c4-af0e-83e06497237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6698fae8-1efa-42c4-af0e-83e06497237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2f1e7b-775e-416f-81cc-ec9f34dac05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:37 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Volume b804a284-760d-44b1-be97-bc3f2017b741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b804a284-760d-44b1-be97-bc3f2017b741', 'volume_size': 1} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1447105925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b804a284-760d-44b1-be97-bc3f2017b741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d4b8b5441949fe9a18444ed33f0ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:37Z,use_quota=True,user_id='fcd94b635f1c446b9a5045b15daef45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(289ba013-9509-417b-adf2-2b9201f4ebb1),volume_type_id=289ba013-9509-417b-adf2-2b9201f4ebb1)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Creating volume b804a284-760d-44b1-be97-bc3f2017b741 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:58:37 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:58:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:37 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 1073741824 Sep 05 20:58:37 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Flow 'volume_create_manager' (efaf5497-c4c0-40e7-a4d0-fde4069bdc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e0adb4-f1be-4507-b7a7-debad2716374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e0adb4-f1be-4507-b7a7-debad2716374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1224915305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d2b476-ad48-4f81-afe1-734efc283713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d4b8b5441949fe9a18444ed33f0ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:38Z,use_quota=True,user_id='fcd94b635f1c446b9a5045b15daef45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7c42da9-9bf7-444f-b7bd-9c493ca0a7eb),volume_type_id=e7c42da9-9bf7-444f-b7bd-9c493ca0a7eb)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82d4097-6663-47ac-9214-83ead6252be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82d4097-6663-47ac-9214-83ead6252be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8980407-ba18-4736-8629-6849573a9f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8980407-ba18-4736-8629-6849573a9f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d2b476-ad48-4f81-afe1-734efc283713', 'volume_name': 'volume-05d2b476-ad48-4f81-afe1-734efc283713', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f8c3a6-7c5d-4083-a24e-ec33e82fa48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f8c3a6-7c5d-4083-a24e-ec33e82fa48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0040e757-35f9-4d1a-97e5-645f52d54e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:38 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Volume 05d2b476-ad48-4f81-afe1-734efc283713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d2b476-ad48-4f81-afe1-734efc283713', 'volume_size': 1} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:38 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 1073741824" returned: 0 in 0.943s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:38 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 Sep 05 20:58:38 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:39 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741" returned: 0 in 0.466s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1224915305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d2b476-ad48-4f81-afe1-734efc283713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d4b8b5441949fe9a18444ed33f0ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:38Z,use_quota=True,user_id='fcd94b635f1c446b9a5045b15daef45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7c42da9-9bf7-444f-b7bd-9c493ca0a7eb),volume_type_id=e7c42da9-9bf7-444f-b7bd-9c493ca0a7eb)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Creating volume 05d2b476-ad48-4f81-afe1-734efc283713 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:58:39 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:39 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 1073741824 Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2f1e7b-775e-416f-81cc-ec9f34dac05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b804a284-760d-44b1-be97-bc3f2017b741', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:39 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdd5713-3702-4d34-b623-94beb5f66f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Volume volume-b804a284-760d-44b1-be97-bc3f2017b741 (b804a284-760d-44b1-be97-bc3f2017b741): created successfully Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdd5713-3702-4d34-b623-94beb5f66f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Flow 'volume_create_manager' (b88d2276-1f09-4c5f-b764-edd6f53b13b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9e3a181d-ea1a-4fec-9bc5-4fe9d729cf6e tempest-TestInstancesWithCinderVolumes-573937096 None] Created volume successfully. Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Flow 'volume_create_manager' (3fa8e2b0-eebb-4db6-aef5-a11d0670c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d8395f-4f6e-477c-a4cd-e52ba9419083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d8395f-4f6e-477c-a4cd-e52ba9419083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-193722752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d893227c-c798-4560-8e5d-9e3afc2dc8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d4b8b5441949fe9a18444ed33f0ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:39Z,use_quota=True,user_id='fcd94b635f1c446b9a5045b15daef45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3472fda-9d46-4829-ac67-1c6df12b91f0),volume_type_id=f3472fda-9d46-4829-ac67-1c6df12b91f0)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23862ed3-1e34-4bab-9c07-c61bf67c20d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23862ed3-1e34-4bab-9c07-c61bf67c20d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0bc9ae-2348-4fdd-b815-e3a05af0daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 20:58:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 1073741824" returned: 0 in 1.008s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:40 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:40 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 Sep 05 20:58:40 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:41 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713" returned: 0 in 0.695s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0bc9ae-2348-4fdd-b815-e3a05af0daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd893227c-c798-4560-8e5d-9e3afc2dc8d8', 'volume_name': 'volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8', 'volume_size': 1, 'image_id': 'ad8be681-c35e-4d8d-ad05-39060508e2c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad8be681-c35e-4d8d-ad05-39060508e2c6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1530917494', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '29d4b8b5441949fe9a18444ed33f0ef1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad8be681-c35e-4d8d-ad05-39060508e2c6', 'created_at': datetime.datetime(2026, 9, 5, 18, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad8be681-c35e-4d8d-ad05-39060508e2c6/file', 'properties': {}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c83bfc-c54d-4b9d-8978-ced0770c6af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c83bfc-c54d-4b9d-8978-ced0770c6af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3349bc59-c8be-4716-ad6a-9d410b8ed728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Volume d893227c-c798-4560-8e5d-9e3afc2dc8d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8', 'volume_size': 1, 'image_id': 'ad8be681-c35e-4d8d-ad05-39060508e2c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad8be681-c35e-4d8d-ad05-39060508e2c6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1530917494', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '29d4b8b5441949fe9a18444ed33f0ef1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad8be681-c35e-4d8d-ad05-39060508e2c6', 'created_at': datetime.datetime(2026, 9, 5, 18, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad8be681-c35e-4d8d-ad05-39060508e2c6/file', 'properties': {}}, 'image_service': } Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Trying to clone d893227c-c798-4560-8e5d-9e3afc2dc8d8 from image ad8be681-c35e-4d8d-ad05-39060508e2c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad8be681-c35e-4d8d-ad05-39060508e2c6', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0040e757-35f9-4d1a-97e5-645f52d54e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d2b476-ad48-4f81-afe1-734efc283713', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661f78ef-3a24-4f87-9660-5d75d110b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Volume volume-05d2b476-ad48-4f81-afe1-734efc283713 (05d2b476-ad48-4f81-afe1-734efc283713): created successfully Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661f78ef-3a24-4f87-9660-5d75d110b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Flow 'volume_create_manager' (efaf5497-c4c0-40e7-a4d0-fde4069bdc04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3c373eb4-0471-483d-b2cb-37ed0443173e tempest-TestInstancesWithCinderVolumes-573937096 None] Created volume successfully. Sep 05 20:58:46 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD, size 20.69 MB, duration 5.84 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 20:58:46 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Image download 20.69 MB at 3.54 MB/s Sep 05 20:58:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[53752cff-198b-43dd-95cc-a3ec14c8b7c0]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:47 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD Sep 05 20:58:47 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:47 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Temporary image ad8be681-c35e-4d8d-ad05-39060508e2c6 is fetched for user fcd94b635f1c446b9a5045b15daef45a. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daad173-1bff-4af9-b9f3-5c127d6242fe]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:47 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD Sep 05 20:58:47 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:47 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-193722752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d893227c-c798-4560-8e5d-9e3afc2dc8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d4b8b5441949fe9a18444ed33f0ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:39Z,use_quota=True,user_id='fcd94b635f1c446b9a5045b15daef45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3472fda-9d46-4829-ac67-1c6df12b91f0),volume_type_id=f3472fda-9d46-4829-ac67-1c6df12b91f0)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Creating volume d893227c-c798-4560-8e5d-9e3afc2dc8d8 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:58:47 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:58:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:47 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 1073741824 Sep 05 20:58:47 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:48 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 1073741824" returned: 0 in 0.514s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:48 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 Sep 05 20:58:48 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:48 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8" returned: 0 in 0.256s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:48 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Attempting download of ad8be681-c35e-4d8d-ad05-39060508e2c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad8be681-c35e-4d8d-ad05-39060508e2c6', 'metadata': {}}])) to volume d893227c-c798-4560-8e5d-9e3afc2dc8d8. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 20:58:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf79961-dd34-465e-924a-e4c641c110f1]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad8be681-c35e-4d8d-ad05-39060508e2c6_es2bioug {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:48 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad8be681-c35e-4d8d-ad05-39060508e2c6_es2bioug Sep 05 20:58:48 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:49 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad8be681-c35e-4d8d-ad05-39060508e2c6_es2bioug" returned: 0 in 0.464s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad8be681-c35e-4d8d-ad05-39060508e2c6_es2bioug {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Flow 'volume_create_manager' (a3f91872-6590-4b57-b876-2d38b9f4ab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686894d8-3a4c-4bb0-9a58-acd020b92e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:49 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad8be681-c35e-4d8d-ad05-39060508e2c6_es2bioug Sep 05 20:58:49 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686894d8-3a4c-4bb0-9a58-acd020b92e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-186827965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26b565d-d42f-474c-8d49-79421963f5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6161300e9fd43868bc5e2c8efe19c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:49Z,use_quota=True,user_id='822ff6e3904f401c9bf9a635bb00ccdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45c158d-b6b3-4bb8-9d9d-f6e54563429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45c158d-b6b3-4bb8-9d9d-f6e54563429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68747b0a-9e72-40f8-be17-8bb78ee55434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68747b0a-9e72-40f8-be17-8bb78ee55434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26b565d-d42f-474c-8d49-79421963f5b9', 'volume_name': 'volume-d26b565d-d42f-474c-8d49-79421963f5b9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9049aebe-8a1d-4a95-9723-c36abe22f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9049aebe-8a1d-4a95-9723-c36abe22f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4069b21-5b58-4926-aed5-463d92d3f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:49 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Volume d26b565d-d42f-474c-8d49-79421963f5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26b565d-d42f-474c-8d49-79421963f5b9', 'volume_size': 1} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-186827965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26b565d-d42f-474c-8d49-79421963f5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6161300e9fd43868bc5e2c8efe19c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:49Z,use_quota=True,user_id='822ff6e3904f401c9bf9a635bb00ccdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Creating volume d26b565d-d42f-474c-8d49-79421963f5b9 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:58:49 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:49 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 1073741824 Sep 05 20:58:49 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:49 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad8be681-c35e-4d8d-ad05-39060508e2c6_es2bioug" returned: 1 in 0.370s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad8be681-c35e-4d8d-ad05-39060508e2c6_es2bioug' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e81f2d-bd0b-4bd8-8517-f6b30c969278]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:49 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD Sep 05 20:58:49 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:49 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 1073741824" returned: 0 in 0.489s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:50 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 Sep 05 20:58:50 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:50 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] ad8be681-c35e-4d8d-ad05-39060508e2c6 was qcow2, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:50 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 Sep 05 20:58:50 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:50 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9" returned: 0 in 0.294s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4069b21-5b58-4926-aed5-463d92d3f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26b565d-d42f-474c-8d49-79421963f5b9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b654440-6ce4-4556-a1f7-7f00db03ea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:50 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Volume volume-d26b565d-d42f-474c-8d49-79421963f5b9 (d26b565d-d42f-474c-8d49-79421963f5b9): created successfully Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b654440-6ce4-4556-a1f7-7f00db03ea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Flow 'volume_create_manager' (a3f91872-6590-4b57-b876-2d38b9f4ab3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-425395ad-c516-4c8f-a16f-5e253e492879 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Created volume successfully. Sep 05 20:58:52 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8" returned: 0 in 2.107s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad8be681-c35e-4d8d-ad05-39060508e2c6_fi9nb25cdevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:58:52 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Converted 112.00 MB image at 53.14 MB/s Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:52 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 1G Sep 05 20:58:52 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:52 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 1G" returned: 0 in 0.390s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Downloaded image ad8be681-c35e-4d8d-ad05-39060508e2c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad8be681-c35e-4d8d-ad05-39060508e2c6', 'metadata': {}}])) to volume d893227c-c798-4560-8e5d-9e3afc2dc8d8 successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Temporary image ad8be681-c35e-4d8d-ad05-39060508e2c6 for user fcd94b635f1c446b9a5045b15daef45a is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Marking volume d893227c-c798-4560-8e5d-9e3afc2dc8d8 as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Copying metadata from image ad8be681-c35e-4d8d-ad05-39060508e2c6 to d893227c-c798-4560-8e5d-9e3afc2dc8d8. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Creating volume glance metadata for volume d893227c-c798-4560-8e5d-9e3afc2dc8d8 backed by image ad8be681-c35e-4d8d-ad05-39060508e2c6 with: {'image_id': 'ad8be681-c35e-4d8d-ad05-39060508e2c6', 'image_name': 'tempest-scenario-img--1530917494', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Acquiring lock "cinder-d26b565d-d42f-474c-8d49-79421963f5b9-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "cinder-d26b565d-d42f-474c-8d49-79421963f5b9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3349bc59-c8be-4716-ad6a-9d410b8ed728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8', 'volume_size': 1, 'image_id': 'ad8be681-c35e-4d8d-ad05-39060508e2c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad8be681-c35e-4d8d-ad05-39060508e2c6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1530917494', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '29d4b8b5441949fe9a18444ed33f0ef1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad8be681-c35e-4d8d-ad05-39060508e2c6', 'created_at': datetime.datetime(2026, 9, 5, 18, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad8be681-c35e-4d8d-ad05-39060508e2c6/file', 'properties': {}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9184ec6-c941-4019-a5b7-7589a5c3b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Acquiring lock "cinder-quobyte-d26b565d-d42f-474c-8d49-79421963f5b9" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Volume volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 (d893227c-c798-4560-8e5d-9e3afc2dc8d8): created successfully Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9184ec6-c941-4019-a5b7-7589a5c3b83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Flow 'volume_create_manager' (3fa8e2b0-eebb-4db6-aef5-a11d0670c371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "cinder-quobyte-d26b565d-d42f-474c-8d49-79421963f5b9" acquired by "delete_volume" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b1b92fd6-192d-4ea2-95d0-950a8920c2da tempest-TestInstancesWithCinderVolumes-573937096 None] Created volume successfully. Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d24ebf-36a8-46b9-bbb2-11521c024329]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:52 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 Sep 05 20:58:52 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:53 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:53 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9 Sep 05 20:58:53 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:53 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d26b565d-d42f-474c-8d49-79421963f5b9" returned: 0 in 0.259s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "cinder-quobyte-d26b565d-d42f-474c-8d49-79421963f5b9" released by "delete_volume" :: held 0.686s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Created reservations ['b1c72809-9083-4c33-9134-daa519ff0f18', '856aafa3-7f59-4bb3-a336-0d528c8ac754', '66141284-5da7-4de8-b770-8e4b21f8f581', '94b4fa33-98b6-4884-a5a9-c1994cfdd814'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:53 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:58:53 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:53 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.291s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Deleted volume successfully. Sep 05 20:58:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-102e2e5d-3669-4997-b841-b1aee75ed0f5 tempest-VolumeQuotasNegativeTestJSON-1821585672 None] Lock "cinder-d26b565d-d42f-474c-8d49-79421963f5b9-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Acquiring lock "cinder-7b342702-8032-447f-8d8d-d7a5ee066640-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Lock "cinder-7b342702-8032-447f-8d8d-d7a5ee066640-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Acquiring lock "cinder-quobyte-7b342702-8032-447f-8d8d-d7a5ee066640" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Lock "cinder-quobyte-7b342702-8032-447f-8d8d-d7a5ee066640" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb6297-60ad-47f4-a15d-ec62ea66c2e9]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:55 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 Sep 05 20:58:55 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:55 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:58:55 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:55 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640" returned: 0 in 0.533s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:55 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640 Sep 05 20:58:55 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:56 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.430s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:58:56 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7b342702-8032-447f-8d8d-d7a5ee066640" returned: 0 in 0.357s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Lock "cinder-quobyte-7b342702-8032-447f-8d8d-d7a5ee066640" released by "delete_volume" :: held 0.938s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Created reservations ['7f5fcf70-f83c-4098-8d9c-6035b49a9679', 'd84d69dc-e581-4b6b-8803-939c3e67ff27', 'df0490d4-c4ec-4ace-b6d6-3f1d963c8d8b', 'ba7668f6-9469-470a-9150-163ccef19698'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:56 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:58:56 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:56 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.303s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Deleted volume successfully. Sep 05 20:58:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d5d145b5-dfbe-48c9-b2e9-07500990b9b2 tempest-VolumesNegativeTest-1117677061 None] Lock "cinder-7b342702-8032-447f-8d8d-d7a5ee066640-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-56ff1117-b544-4cb8-8997-ac2b81938e4d req-228ca75b-941a-4d87-badd-ea2573c84b18 tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-56ff1117-b544-4cb8-8997-ac2b81938e4d req-228ca75b-941a-4d87-badd-ea2573c84b18 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-56ff1117-b544-4cb8-8997-ac2b81938e4d req-228ca75b-941a-4d87-badd-ea2573c84b18 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-56ff1117-b544-4cb8-8997-ac2b81938e4d req-228ca75b-941a-4d87-badd-ea2573c84b18 tempest-TestInstancesWithCinderVolumes-573937096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63b33863-6af5-471c-bdc2-40514e56c428', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:58:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-56ff1117-b544-4cb8-8997-ac2b81938e4d req-228ca75b-941a-4d87-badd-ea2573c84b18 tempest-TestInstancesWithCinderVolumes-573937096 None] attachment_update completed successfully. Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Flow 'volume_create_manager' (1bd9cb5e-2d56-4697-b4f2-0ab9246856e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a880b7b8-4c96-4096-a958-a49c03d2c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a880b7b8-4c96-4096-a958-a49c03d2c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-63552541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdb79a0-4401-4b7a-93dd-287045e56db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420e60f070ca4cd18cfc16506d93a062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:04Z,use_quota=True,user_id='759c2b2e363d47fcbc4a7e8ecd445766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(907a4227-c17c-4db8-927c-ce11b19230db),volume_type_id=907a4227-c17c-4db8-927c-ce11b19230db)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3492ed5-c737-47c0-b519-97342b33f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3492ed5-c737-47c0-b519-97342b33f32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490dfdcc-6998-45bc-96d8-e443111d63f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490dfdcc-6998-45bc-96d8-e443111d63f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bdb79a0-4401-4b7a-93dd-287045e56db7', 'volume_name': 'volume-2bdb79a0-4401-4b7a-93dd-287045e56db7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1e1b02-ed86-4d82-b224-ee75c09d3d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1e1b02-ed86-4d82-b224-ee75c09d3d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdde158-c82e-4b7c-ad66-5659ad573926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:04 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Volume 2bdb79a0-4401-4b7a-93dd-287045e56db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bdb79a0-4401-4b7a-93dd-287045e56db7', 'volume_size': 1} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-63552541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdb79a0-4401-4b7a-93dd-287045e56db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420e60f070ca4cd18cfc16506d93a062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:04Z,use_quota=True,user_id='759c2b2e363d47fcbc4a7e8ecd445766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(907a4227-c17c-4db8-927c-ce11b19230db),volume_type_id=907a4227-c17c-4db8-927c-ce11b19230db)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Creating volume 2bdb79a0-4401-4b7a-93dd-287045e56db7 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:59:04 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:59:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:04 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 1073741824 Sep 05 20:59:04 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:05 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 1073741824" returned: 0 in 0.862s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:05 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 Sep 05 20:59:05 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:06 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdde158-c82e-4b7c-ad66-5659ad573926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bdb79a0-4401-4b7a-93dd-287045e56db7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd29eda-322f-4b9b-bc33-5c1523ee47ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:06 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Volume volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 (2bdb79a0-4401-4b7a-93dd-287045e56db7): created successfully Sep 05 20:59:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd29eda-322f-4b9b-bc33-5c1523ee47ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Flow 'volume_create_manager' (1bd9cb5e-2d56-4697-b4f2-0ab9246856e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:06 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ceb7c6d6-b3c6-4502-bc38-5a410ebcc31c tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Created volume successfully. Sep 05 20:59:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:07 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:07 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:07 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.474s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:07 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:08 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c5ac0a2f-03e4-4d9c-b986-ae9f21534cc3 tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Retype volume completed successfully. Sep 05 20:59:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Acquiring lock "cinder-2bdb79a0-4401-4b7a-93dd-287045e56db7-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "cinder-2bdb79a0-4401-4b7a-93dd-287045e56db7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Acquiring lock "cinder-quobyte-2bdb79a0-4401-4b7a-93dd-287045e56db7" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "cinder-quobyte-2bdb79a0-4401-4b7a-93dd-287045e56db7" acquired by "delete_volume" :: waited 0.040s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:09 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09610a7-1e5e-464b-af3f-0d4df0614b30]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:09 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 Sep 05 20:59:09 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:09 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7" returned: 0 in 0.687s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:10 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7 Sep 05 20:59:10 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:10 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2bdb79a0-4401-4b7a-93dd-287045e56db7" returned: 0 in 0.520s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "cinder-quobyte-2bdb79a0-4401-4b7a-93dd-287045e56db7" released by "delete_volume" :: held 1.285s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:10 devstack cinder-volume[87802]: WARNING cinder.quota [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:10 devstack cinder-volume[87802]: WARNING cinder.quota [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Created reservations ['7ca74f2b-8f30-496a-97ab-ba5021626998', '7af7610d-4003-4e0f-90b9-6281950aef2a', 'f2c2eeb8-89c1-4013-a4cc-3d43bc578f76', '15937bbf-8453-4ae8-abf4-f582650b30a4'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:10 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:10 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:11 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.504s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:11 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:11 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Deleted volume successfully. Sep 05 20:59:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-832f21a2-829e-4ce4-8fc5-1a51340494ae tempest-VolumeRetypeWithoutMigrationTest-1353761532 None] Lock "cinder-2bdb79a0-4401-4b7a-93dd-287045e56db7-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:20 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=66,cinder:INSERT=13,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=64,cinder:INSERT=23,cinder:UPDATE=66,cinder:DELETE=6 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (c5f5a347-0265-4f41-bbb2-20eadaaf39d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600b9b45-26f9-4e57-9503-29edb87f01cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600b9b45-26f9-4e57-9503-29edb87f01cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1332700182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3191b0-bf03-44e3-b394-3d8ed434ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc3e719a5994141b3b3d053a9f4cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:21Z,use_quota=True,user_id='ee466a7ca9a8475fa2d2e9badd81d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc78da2c-f639-4325-b8bd-0f9928de8919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc78da2c-f639-4325-b8bd-0f9928de8919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f11e86-0e84-43df-9d13-fb818f5fe5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f11e86-0e84-43df-9d13-fb818f5fe5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3191b0-bf03-44e3-b394-3d8ed434ec95', 'volume_name': 'volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1745d0-98bc-4f10-b024-fb46086a8d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1745d0-98bc-4f10-b024-fb46086a8d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9fef9e-5011-4cd9-b8ae-ca91f110f567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:21 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Volume ae3191b0-bf03-44e3-b394-3d8ed434ec95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95', 'volume_size': 1} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1332700182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3191b0-bf03-44e3-b394-3d8ed434ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc3e719a5994141b3b3d053a9f4cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:21Z,use_quota=True,user_id='ee466a7ca9a8475fa2d2e9badd81d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Creating volume ae3191b0-bf03-44e3-b394-3d8ed434ec95 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:59:21 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:21 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 1073741824 Sep 05 20:59:21 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:21 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 1073741824" returned: 0 in 0.543s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:22 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 Sep 05 20:59:22 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:22 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95" returned: 0 in 0.332s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9fef9e-5011-4cd9-b8ae-ca91f110f567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf444ea-6f28-4e44-a856-eb81edf3ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:22 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Volume volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 (ae3191b0-bf03-44e3-b394-3d8ed434ec95): created successfully Sep 05 20:59:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf444ea-6f28-4e44-a856-eb81edf3ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (c5f5a347-0265-4f41-bbb2-20eadaaf39d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:22 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7920b3c4-3deb-4013-b6ff-18b2ddc7b6bf tempest-VolumesSnapshotTestJSON-1939433628 None] Created volume successfully. Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Flow 'volume_create_manager' (6fe3eac8-d1b2-4556-b53a-65503c372b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228d380a-2af2-4bd4-b885-3053af1020e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228d380a-2af2-4bd4-b885-3053af1020e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-759797109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5257308-fc4f-47cf-84c7-e51cfebabfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7b8bf2010b4be7a3207de35ddf31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:24Z,use_quota=True,user_id='86519fc57b594a17afefd92aee2dc5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0d7e0ea-4671-4faa-b9c0-7954dc198a05),volume_type_id=c0d7e0ea-4671-4faa-b9c0-7954dc198a05)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8750d120-b915-4741-ae3a-df4ef84d1a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8750d120-b915-4741-ae3a-df4ef84d1a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a198f640-a4ff-49e6-a81a-cf7d45ca21b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a198f640-a4ff-49e6-a81a-cf7d45ca21b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5257308-fc4f-47cf-84c7-e51cfebabfad', 'volume_name': 'volume-f5257308-fc4f-47cf-84c7-e51cfebabfad', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51695729-f2fc-493f-9116-8f0bfb003c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51695729-f2fc-493f-9116-8f0bfb003c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5567c1-5da8-4eac-862e-99cbd846204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Volume f5257308-fc4f-47cf-84c7-e51cfebabfad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5257308-fc4f-47cf-84c7-e51cfebabfad', 'volume_size': 1} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Creating offline snapshot 86504e46-90e6-4ad8-a859-f8cc81141527 of volume ae3191b0-bf03-44e3-b394-3d8ed434ec95 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01c450-395d-4014-9e54-e434df557c07]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:24 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 Sep 05 20:59:24 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:24 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95" returned: 0 in 0.403s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:24 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 1G Sep 05 20:59:24 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:25 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 1G" returned: 0 in 0.493s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:25 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 Sep 05 20:59:25 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:25 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527" returned: 0 in 0.315s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:25 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 is being set with open permissions: ugo+rw Sep 05 20:59:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:25 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 Sep 05 20:59:25 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:25 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527" returned: 0 in 0.289s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:25 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.info Sep 05 20:59:25 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:26 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.info" returned: 0 in 0.323s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:26 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.info is being set with open permissions: ugo+rw Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:26 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.info Sep 05 20:59:26 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:26 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.info" returned: 0 in 0.278s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-759797109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5257308-fc4f-47cf-84c7-e51cfebabfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7b8bf2010b4be7a3207de35ddf31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:24Z,use_quota=True,user_id='86519fc57b594a17afefd92aee2dc5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0d7e0ea-4671-4faa-b9c0-7954dc198a05),volume_type_id=c0d7e0ea-4671-4faa-b9c0-7954dc198a05)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Creating volume f5257308-fc4f-47cf-84c7-e51cfebabfad {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:59:26 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:26 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad 1073741824 Sep 05 20:59:26 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6da53c32-c8c9-4921-9114-e88f7c765e65 tempest-VolumesSnapshotTestJSON-1939433628 None] Create snapshot completed successfully Sep 05 20:59:26 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad 1073741824" returned: 0 in 0.484s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:26 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad Sep 05 20:59:26 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:27 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad" returned: 0 in 0.289s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5567c1-5da8-4eac-862e-99cbd846204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5257308-fc4f-47cf-84c7-e51cfebabfad', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83be7aa-2b72-4790-9fc3-4eb60bee6b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:27 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Volume volume-f5257308-fc4f-47cf-84c7-e51cfebabfad (f5257308-fc4f-47cf-84c7-e51cfebabfad): created successfully Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83be7aa-2b72-4790-9fc3-4eb60bee6b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Flow 'volume_create_manager' (6fe3eac8-d1b2-4556-b53a-65503c372b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-86504e46-90e6-4ad8-a859-f8cc81141527-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0fae4efb-2e94-4f30-98a7-e2e49343bce5 tempest-VolumeTypesAccessTest-439652812 None] Created volume successfully. Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-86504e46-90e6-4ad8-a859-f8cc81141527-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-ae3191b0-bf03-44e3-b394-3d8ed434ec95" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-ae3191b0-bf03-44e3-b394-3d8ed434ec95" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-86504e46-90e6-4ad8-a859-f8cc81141527" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-86504e46-90e6-4ad8-a859-f8cc81141527" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Deleting offline snapshot 86504e46-90e6-4ad8-a859-f8cc81141527 of volume ae3191b0-bf03-44e3-b394-3d8ed434ec95 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] snapshot_file for this snap is: volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a8e734-88f6-4d6b-baa4-58723dc3d392]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:27 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 Sep 05 20:59:27 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:27 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a47765-d288-4812-9ed3-c065821aeba9]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:27 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 Sep 05 20:59:27 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:28 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95" returned: 0 in 0.387s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:28 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 Sep 05 20:59:28 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Acquiring lock "cinder-f5257308-fc4f-47cf-84c7-e51cfebabfad-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Lock "cinder-f5257308-fc4f-47cf-84c7-e51cfebabfad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Acquiring lock "cinder-quobyte-f5257308-fc4f-47cf-84c7-e51cfebabfad" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Lock "cinder-quobyte-f5257308-fc4f-47cf-84c7-e51cfebabfad" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c227630-194f-4955-8bb0-411b59f43d9f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:28 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad Sep 05 20:59:28 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:28 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527" returned: 0 in 0.407s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:28 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527 Sep 05 20:59:28 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:28 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad" returned: 0 in 0.444s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:28 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad Sep 05 20:59:28 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:28 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95.86504e46-90e6-4ad8-a859-f8cc81141527" returned: 0 in 0.347s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-86504e46-90e6-4ad8-a859-f8cc81141527" released by "_delete_snapshot" :: held 1.674s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-ae3191b0-bf03-44e3-b394-3d8ed434ec95" released by "delete_snapshot" :: held 1.699s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Created reservations ['448c29a1-b817-4904-a6e2-502148338c9c', '3b6db43f-a280-4f33-bff4-a4ab4cbd81d8', 'f1c2cae7-56b4-411d-8772-61014c9d58a2', 'bd02b906-b1c2-4242-970a-b388b17f4ce9'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:29 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Delete snapshot completed successfully. Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f5257308-fc4f-47cf-84c7-e51cfebabfad" returned: 0 in 0.317s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6ed1c11a-7af5-430e-a96f-ecd6ad36c9ca tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-86504e46-90e6-4ad8-a859-f8cc81141527-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Lock "cinder-quobyte-f5257308-fc4f-47cf-84c7-e51cfebabfad" released by "delete_volume" :: held 0.815s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:29 devstack cinder-volume[87802]: WARNING cinder.quota [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1460922166 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1460922166, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:29 devstack cinder-volume[87802]: WARNING cinder.quota [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1460922166 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1460922166, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Created reservations ['1f4d8595-5847-4000-a402-8058be516960', 'b41b5842-8e90-4b83-9c1b-9d7a5e76edf0', '297d6bce-5be4-4c59-911d-6515ac586970', '468f5518-1899-48aa-adf5-1d1b7a04e7fb'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:29 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:29 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:29 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.434s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Deleted volume successfully. Sep 05 20:59:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e38df9a5-7c2d-4f8e-bdbf-c60522096664 tempest-VolumeTypesAccessTest-439652812 None] Lock "cinder-f5257308-fc4f-47cf-84c7-e51cfebabfad-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (aba98d42-0af0-48f0-96b9-2792abd7edf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a974d271-03e0-446d-bd42-75842a0d8707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a974d271-03e0-446d-bd42-75842a0d8707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-988168482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc3e719a5994141b3b3d053a9f4cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:30Z,use_quota=True,user_id='ee466a7ca9a8475fa2d2e9badd81d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6631812a-e66c-4dba-99dd-e9c6af395724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6631812a-e66c-4dba-99dd-e9c6af395724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccc10d7-39ab-4c20-a10e-0fd748cd5898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccc10d7-39ab-4c20-a10e-0fd748cd5898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0', 'volume_name': 'volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944427b9-8a97-4f52-b681-adae805eb1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944427b9-8a97-4f52-b681-adae805eb1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a24ddc-658e-41ef-844f-4913b3b4013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:30 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Volume dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0', 'volume_size': 1} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-988168482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc3e719a5994141b3b3d053a9f4cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:30Z,use_quota=True,user_id='ee466a7ca9a8475fa2d2e9badd81d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Creating volume dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:59:30 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:59:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:30 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 1073741824 Sep 05 20:59:30 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:31 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 1073741824" returned: 0 in 0.688s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:31 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 Sep 05 20:59:31 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:31 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" returned: 0 in 0.404s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a24ddc-658e-41ef-844f-4913b3b4013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb874b2b-e5cd-4916-b84a-88cb9cca1efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:31 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Volume volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 (dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0): created successfully Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb874b2b-e5cd-4916-b84a-88cb9cca1efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (aba98d42-0af0-48f0-96b9-2792abd7edf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:31 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-87b1faeb-bbb3-4ce8-bdc0-f435034afcd3 tempest-VolumesSnapshotTestJSON-1939433628 None] Created volume successfully. Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-12510aaa-0be7-4857-acf5-fe855d105401 req-957c50d0-3b89-4cc8-9fad-fca98bfa7864 tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-12510aaa-0be7-4857-acf5-fe855d105401 req-957c50d0-3b89-4cc8-9fad-fca98bfa7864 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-12510aaa-0be7-4857-acf5-fe855d105401 req-957c50d0-3b89-4cc8-9fad-fca98bfa7864 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-12510aaa-0be7-4857-acf5-fe855d105401 req-957c50d0-3b89-4cc8-9fad-fca98bfa7864 tempest-TestInstancesWithCinderVolumes-573937096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-b804a284-760d-44b1-be97-bc3f2017b741', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd68272e8-44c9-45ce-a49b-a7b0967ce11a', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:59:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-12510aaa-0be7-4857-acf5-fe855d105401 req-957c50d0-3b89-4cc8-9fad-fca98bfa7864 tempest-TestInstancesWithCinderVolumes-573937096 None] attachment_update completed successfully. Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Creating offline snapshot a1a4640a-8df1-42e2-87c0-caef66b15123 of volume dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a1408c-afe2-4a73-838e-6110c84170e8]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:32 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 Sep 05 20:59:32 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:33 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" returned: 0 in 0.455s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:33 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 1G Sep 05 20:59:33 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:33 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 1G" returned: 0 in 0.529s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:33 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 Sep 05 20:59:33 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:34 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123" returned: 0 in 0.385s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:34 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 is being set with open permissions: ugo+rw Sep 05 20:59:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:34 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 Sep 05 20:59:34 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:34 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123" returned: 0 in 0.274s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:34 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.info Sep 05 20:59:34 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:34 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.info" returned: 0 in 0.293s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:34 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.info is being set with open permissions: ugo+rw Sep 05 20:59:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:34 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.info Sep 05 20:59:34 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:35 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.info" returned: 0 in 0.278s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b7306c68-5fd9-442a-9ca5-ba8e74c9aeec tempest-VolumesSnapshotTestJSON-1939433628 None] Create snapshot completed successfully Sep 05 20:59:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-53cc733e-fa08-406a-9b97-1bf9a3f9d3e6 req-b0c05878-70ac-4bd4-a3ff-1185f334816d tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-53cc733e-fa08-406a-9b97-1bf9a3f9d3e6 req-b0c05878-70ac-4bd4-a3ff-1185f334816d tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-53cc733e-fa08-406a-9b97-1bf9a3f9d3e6 req-b0c05878-70ac-4bd4-a3ff-1185f334816d tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-53cc733e-fa08-406a-9b97-1bf9a3f9d3e6 req-b0c05878-70ac-4bd4-a3ff-1185f334816d tempest-TestInstancesWithCinderVolumes-573937096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-05d2b476-ad48-4f81-afe1-734efc283713', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd50c241d-24ca-4ad9-835d-40e8ba9921cc', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:59:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-53cc733e-fa08-406a-9b97-1bf9a3f9d3e6 req-b0c05878-70ac-4bd4-a3ff-1185f334816d tempest-TestInstancesWithCinderVolumes-573937096 None] attachment_update completed successfully. Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (f92f5ea6-697f-42d6-b5b1-512d5224b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab977348-493a-4e5c-87a5-5bb99a941782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab977348-493a-4e5c-87a5-5bb99a941782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1915538476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92176bfb-6fcb-41b5-8f67-2e319657c28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc3e719a5994141b3b3d053a9f4cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a1a4640a-8df1-42e2-87c0-caef66b15123,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:36Z,use_quota=True,user_id='ee466a7ca9a8475fa2d2e9badd81d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8913e4c7-49f1-43aa-9b0e-675847472650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8913e4c7-49f1-43aa-9b0e-675847472650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aa90ef-1fe0-4eae-b597-0896a6d638ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aa90ef-1fe0-4eae-b597-0896a6d638ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '92176bfb-6fcb-41b5-8f67-2e319657c28d', 'volume_name': 'volume-92176bfb-6fcb-41b5-8f67-2e319657c28d', 'volume_size': 2, 'snapshot_id': 'a1a4640a-8df1-42e2-87c0-caef66b15123'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35af08b1-a2ab-4509-b44b-93f048844cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35af08b1-a2ab-4509-b44b-93f048844cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef448e2-fcf0-41f8-b3fd-942b7e02e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:36 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Volume 92176bfb-6fcb-41b5-8f67-2e319657c28d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-92176bfb-6fcb-41b5-8f67-2e319657c28d', 'volume_size': 2, 'snapshot_id': 'a1a4640a-8df1-42e2-87c0-caef66b15123'} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-a1a4640a-8df1-42e2-87c0-caef66b15123-92176bfb-6fcb-41b5-8f67-2e319657c28d" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-a1a4640a-8df1-42e2-87c0-caef66b15123-92176bfb-6fcb-41b5-8f67-2e319657c28d" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Creating volume 92176bfb-6fcb-41b5-8f67-2e319657c28d from snapshot a1a4640a-8df1-42e2-87c0-caef66b15123 {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-92176bfb-6fcb-41b5-8f67-2e319657c28d" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-92176bfb-6fcb-41b5-8f67-2e319657c28d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] snapshot: a1a4640a-8df1-42e2-87c0-caef66b15123, volume: 92176bfb-6fcb-41b5-8f67-2e319657c28d, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[de70f12c-f7e0-4392-aca4-5a7228d977df]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:36 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 Sep 05 20:59:36 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:37 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123" returned: 0 in 0.469s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1788f43c-5f07-4832-8b16-b1a165de6dde]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:37 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 Sep 05 20:59:37 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:37 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" returned: 0 in 0.447s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:59:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:37 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d Sep 05 20:59:37 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-175c4841-da45-4025-b856-f79c1f25e1ee req-eca78c9d-eb6d-4847-862d-151592cd47fa tempest-TestInstancesWithCinderVolumes-573937096 None] Terminate volume connection completed successfully. Sep 05 20:59:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-175c4841-da45-4025-b856-f79c1f25e1ee req-eca78c9d-eb6d-4847-862d-151592cd47fa tempest-TestInstancesWithCinderVolumes-573937096 None] Deleting attachment d68272e8-44c9-45ce-a49b-a7b0967ce11a. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:59:44 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-6145ddcb-6db7-4738-8c9e-0b5f4670a3dd req-f68d677d-055a-42f2-9332-8d3b5cd05b27 tempest-TestMinimumBasicScenario-1196548303 None] Terminate volume connection completed successfully. Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-6145ddcb-6db7-4738-8c9e-0b5f4670a3dd req-f68d677d-055a-42f2-9332-8d3b5cd05b27 tempest-TestMinimumBasicScenario-1196548303 None] Deleting attachment cfa44ac8-4726-4ef1-bb76-aa0070aca1c1. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:59:44 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d" returned: 0 in 6.584s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:59:44 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Converted 1024.00 MB image at 155.51 MB/s Sep 05 20:59:44 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d is being set with open permissions: ugo+rw Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:44 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d Sep 05 20:59:44 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:44 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d" returned: 0 in 0.364s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-92176bfb-6fcb-41b5-8f67-2e319657c28d" released by "_copy_volume_from_snapshot" :: held 7.973s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-a1a4640a-8df1-42e2-87c0-caef66b15123-92176bfb-6fcb-41b5-8f67-2e319657c28d" released by "_create_volume_from_snapshot" :: held 8.051s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.065s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Acquiring lock "cinder-3bbdeebf-671f-4661-8db4-1a4b4390bd7b-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef448e2-fcf0-41f8-b3fd-942b7e02e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92176bfb-6fcb-41b5-8f67-2e319657c28d', 'volume_size': 2, 'snapshot_id': 'a1a4640a-8df1-42e2-87c0-caef66b15123'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecad204e-c026-4ead-a2a4-c6d9e2907f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Lock "cinder-3bbdeebf-671f-4661-8db4-1a4b4390bd7b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:44 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Volume volume-92176bfb-6fcb-41b5-8f67-2e319657c28d (92176bfb-6fcb-41b5-8f67-2e319657c28d): created successfully Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecad204e-c026-4ead-a2a4-c6d9e2907f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (f92f5ea6-697f-42d6-b5b1-512d5224b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Acquiring lock "cinder-quobyte-3bbdeebf-671f-4661-8db4-1a4b4390bd7b" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Lock "cinder-quobyte-3bbdeebf-671f-4661-8db4-1a4b4390bd7b" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:44 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-23fd8a76-5217-4374-87fc-481ecf99fcc0 tempest-VolumesSnapshotTestJSON-1939433628 None] Created volume successfully. Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[496f0de5-9a91-4b0a-a940-b52a778e34e5]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "cinder-b804a284-760d-44b1-be97-bc3f2017b741-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-b804a284-760d-44b1-be97-bc3f2017b741-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "cinder-quobyte-b804a284-760d-44b1-be97-bc3f2017b741" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-quobyte-b804a284-760d-44b1-be97-bc3f2017b741" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:45 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b Sep 05 20:59:45 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4efef86-1b15-4c36-a71a-448b40f5285b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:45 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 Sep 05 20:59:45 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:45 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b" returned: 0 in 0.523s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:45 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b Sep 05 20:59:45 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-92176bfb-6fcb-41b5-8f67-2e319657c28d-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:45 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741" returned: 0 in 0.578s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-92176bfb-6fcb-41b5-8f67-2e319657c28d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:45 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741 Sep 05 20:59:45 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-92176bfb-6fcb-41b5-8f67-2e319657c28d" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-92176bfb-6fcb-41b5-8f67-2e319657c28d" acquired by "delete_volume" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940525f-ec2f-454b-9bd9-003fe731a4ed]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:46 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d Sep 05 20:59:46 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:46 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bbdeebf-671f-4661-8db4-1a4b4390bd7b" returned: 0 in 0.599s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Lock "cinder-quobyte-3bbdeebf-671f-4661-8db4-1a4b4390bd7b" released by "delete_volume" :: held 1.198s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:46 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b804a284-760d-44b1-be97-bc3f2017b741" returned: 0 in 0.424s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-quobyte-b804a284-760d-44b1-be97-bc3f2017b741" released by "delete_volume" :: held 1.068s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Created reservations ['50f27d22-b7b8-4da1-997b-72e7b5a37fc8', 'c97d66c3-c17d-4b22-9f7a-a019053ce3e2', '46452702-1c89-433b-8b57-141a731c3e2d', '72bc4cdd-f14f-44a1-ae61-621b0e8525f0'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:46 devstack cinder-volume[87802]: WARNING cinder.quota [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-432956971-191189087 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-432956971-191189087, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:46 devstack cinder-volume[87802]: WARNING cinder.quota [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-432956971-191189087 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-432956971-191189087, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Created reservations ['ccc257cf-3d55-4feb-89c6-a36db797942c', '67e92f3b-9b12-4db6-b476-36bbfac6b8ee', '920a4a7f-cfcd-40b2-bebd-58f3d50178fd', '301c8e7f-708e-4c65-a7c9-98d311c85484'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:46 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d" returned: 0 in 0.537s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:46 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:46 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:46 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d Sep 05 20:59:46 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:46 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:46 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:46 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-92176bfb-6fcb-41b5-8f67-2e319657c28d" returned: 0 in 0.457s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:46 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.509s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:46 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-92176bfb-6fcb-41b5-8f67-2e319657c28d" released by "delete_volume" :: held 1.095s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Deleted volume successfully. Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-44f0ebe1-500e-41af-9920-bce74ca0e9a8 tempest-TestMinimumBasicScenario-1196548303 None] Lock "cinder-3bbdeebf-671f-4661-8db4-1a4b4390bd7b-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:47 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Created reservations ['5d1b025c-4e7b-488c-b94d-7b01d10cb528', 'c63edfd9-f362-447b-a0a9-4a58255814e3', '1c7c228d-364b-4962-8a7a-4ec0836fb114', '18d373ea-4e33-4f0a-93df-93848aa06c8f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.610s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Deleted volume successfully. Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c30f28b6-b622-4977-b61f-12bc8cbfdda7 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-b804a284-760d-44b1-be97-bc3f2017b741-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:47 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:47 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:47 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.440s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Deleted volume successfully. Sep 05 20:59:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-dfca4132-9835-491e-a107-f58f1874b5bf tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-92176bfb-6fcb-41b5-8f67-2e319657c28d-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-a1a4640a-8df1-42e2-87c0-caef66b15123-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-a1a4640a-8df1-42e2-87c0-caef66b15123-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-a1a4640a-8df1-42e2-87c0-caef66b15123" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-a1a4640a-8df1-42e2-87c0-caef66b15123" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Deleting offline snapshot a1a4640a-8df1-42e2-87c0-caef66b15123 of volume dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] snapshot_file for this snap is: volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[278f3f46-3229-40d1-a739-f3e55f35b2cc]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:48 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 Sep 05 20:59:48 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:48 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123" returned: 0 in 0.542s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b1a2d5-f01c-4d8f-8462-0f394e723c08]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:49 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 Sep 05 20:59:49 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:49 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" returned: 0 in 0.685s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:49 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 Sep 05 20:59:49 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:50 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123" returned: 0 in 0.571s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:50 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123 Sep 05 20:59:50 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-a6ecd04d-3572-4504-8546-bef18bb2da28 req-b5eb6f87-b0c2-45a8-850f-04bdc4d6ca95 tempest-TestInstancesWithCinderVolumes-573937096 None] Terminate volume connection completed successfully. Sep 05 20:59:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-a6ecd04d-3572-4504-8546-bef18bb2da28 req-b5eb6f87-b0c2-45a8-850f-04bdc4d6ca95 tempest-TestInstancesWithCinderVolumes-573937096 None] Deleting attachment d50c241d-24ca-4ad9-835d-40e8ba9921cc. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:59:50 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0.a1a4640a-8df1-42e2-87c0-caef66b15123" returned: 0 in 0.402s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-a1a4640a-8df1-42e2-87c0-caef66b15123" released by "_delete_snapshot" :: held 2.345s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" released by "delete_snapshot" :: held 2.384s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:50 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Created reservations ['9077fab1-9283-407e-9b93-0d2047390de6', '3226ae6d-b507-40af-8067-f68689a63101', 'fb1dbc37-8795-4eb2-92f7-09eb3dcac84a', '742ffef8-6fcb-46b7-8261-253b1adc6d79'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Delete snapshot completed successfully. Sep 05 20:59:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d8ac31e3-764a-42a0-abdc-7451cf45e2a9 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-a1a4640a-8df1-42e2-87c0-caef66b15123-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "cinder-05d2b476-ad48-4f81-afe1-734efc283713-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-05d2b476-ad48-4f81-afe1-734efc283713-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "cinder-quobyte-05d2b476-ad48-4f81-afe1-734efc283713" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-quobyte-05d2b476-ad48-4f81-afe1-734efc283713" acquired by "delete_volume" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6da84f7-7494-4708-adcc-9fc2c032ca20]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:51 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 Sep 05 20:59:51 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:51 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713" returned: 0 in 0.416s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:51 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713 Sep 05 20:59:51 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" acquired by "delete_volume" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[351515c2-3a5f-46dc-ad22-c6b9ffaac6ea]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:52 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-05d2b476-ad48-4f81-afe1-734efc283713" returned: 0 in 0.418s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-quobyte-05d2b476-ad48-4f81-afe1-734efc283713" released by "delete_volume" :: held 0.914s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:52 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 Sep 05 20:59:52 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:52 devstack cinder-volume[87802]: WARNING cinder.quota [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813405329-54796965 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813405329-54796965, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:52 devstack cinder-volume[87802]: WARNING cinder.quota [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813405329-54796965 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813405329-54796965, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Created reservations ['9d659921-7920-4c39-b920-ee5d4fce9fa3', 'd6ea486e-b374-4185-979f-255f480e158c', 'b0957554-4736-4589-8b8c-b1d29473c794', '69b9976e-a2eb-4efa-a658-71136ca94810'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:52 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:52 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:52 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" returned: 0 in 0.552s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:52 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0 Sep 05 20:59:52 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:52 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.346s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Deleted volume successfully. Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7991efd0-e292-4528-8b41-52e9a1e18b6a tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-05d2b476-ad48-4f81-afe1-734efc283713-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:52 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" returned: 0 in 0.349s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0" released by "delete_volume" :: held 1.017s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:52 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Created reservations ['bf952662-f994-41cb-84b8-3363649e07d7', '1b9569d0-3fe0-4f2b-813b-cb06cbb1e724', '9bed432c-22ea-4970-8bd8-3729dfa80e97', '498453ca-8d90-4e6f-b118-a5980fd40b5f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:53 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:53 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:53 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.411s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Deleted volume successfully. Sep 05 20:59:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10c4141b-a5ed-4739-a0dd-deae2f747fe0 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-dbb6eac4-916e-4a31-a0ea-46d57dc4fdb0-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (694747eb-1bf7-43c9-b578-32fcac1b53d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a7975b-229d-4bdf-bb3a-da259d9171b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a7975b-229d-4bdf-bb3a-da259d9171b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-471417256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1a88c1-03cb-4885-9ad0-a2f2c8e87402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc3e719a5994141b3b3d053a9f4cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:55Z,use_quota=True,user_id='ee466a7ca9a8475fa2d2e9badd81d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cef86de-698e-431f-94bb-8501b23c525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cef86de-698e-431f-94bb-8501b23c525e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b5eda5-e248-4d77-aa33-7590cd2c601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b5eda5-e248-4d77-aa33-7590cd2c601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1a88c1-03cb-4885-9ad0-a2f2c8e87402', 'volume_name': 'volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310ecc12-eeac-4eed-a4a5-56369ceeab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310ecc12-eeac-4eed-a4a5-56369ceeab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567a97f4-e580-4b1b-9bde-c36edc4fc62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Volume 0a1a88c1-03cb-4885-9ad0-a2f2c8e87402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402', 'volume_size': 1} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-471417256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1a88c1-03cb-4885-9ad0-a2f2c8e87402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc3e719a5994141b3b3d053a9f4cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:55Z,use_quota=True,user_id='ee466a7ca9a8475fa2d2e9badd81d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Creating volume 0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 20:59:54 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 20:59:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:55 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 1073741824 Sep 05 20:59:55 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:55 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:55 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:55 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 1073741824" returned: 0 in 0.793s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:55 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 Sep 05 20:59:55 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:56 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.400s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:59:56 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" returned: 0 in 0.402s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567a97f4-e580-4b1b-9bde-c36edc4fc62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5568f2-6f7d-4568-91d2-64028c112b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:56 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Volume volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 (0a1a88c1-03cb-4885-9ad0-a2f2c8e87402): created successfully Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5568f2-6f7d-4568-91d2-64028c112b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (694747eb-1bf7-43c9-b578-32fcac1b53d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-4c75060d-b57d-4205-b4c7-e881a172a07e tempest-VolumesSnapshotTestJSON-1939433628 None] Created volume successfully. Sep 05 20:59:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-5d094723-6cef-40c9-a775-f19ea3d03e00 req-d99dc065-6c02-4a20-b475-d13088c9bded tempest-TestInstancesWithCinderVolumes-573937096 None] Terminate volume connection completed successfully. Sep 05 20:59:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-5d094723-6cef-40c9-a775-f19ea3d03e00 req-d99dc065-6c02-4a20-b475-d13088c9bded tempest-TestInstancesWithCinderVolumes-573937096 None] Deleting attachment 63b33863-6af5-471c-bdc2-40514e56c428. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:59:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Creating offline snapshot 78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 of volume 0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:59:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f9ac6-9087-4c41-991b-ee3af32e0a10]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:57 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 Sep 05 20:59:57 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:57 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" returned: 0 in 0.600s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:57 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 1G Sep 05 20:59:57 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "cinder-d893227c-c798-4560-8e5d-9e3afc2dc8d8-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-d893227c-c798-4560-8e5d-9e3afc2dc8d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "cinder-quobyte-d893227c-c798-4560-8e5d-9e3afc2dc8d8" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-quobyte-d893227c-c798-4560-8e5d-9e3afc2dc8d8" acquired by "delete_volume" :: waited 0.013s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d924a5-bd93-4747-9029-bc4fe99346c9]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:58 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 1G" returned: 0 in 0.571s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:58 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 Sep 05 20:59:58 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:58 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 Sep 05 20:59:58 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:58 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" returned: 0 in 0.405s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:58 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 is being set with open permissions: ugo+rw Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:58 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 Sep 05 20:59:58 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8" returned: 0 in 0.516s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:58 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:58 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8 Sep 05 20:59:58 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:59 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" returned: 0 in 0.342s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:59 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d893227c-c798-4560-8e5d-9e3afc2dc8d8" returned: 0 in 0.304s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-quobyte-d893227c-c798-4560-8e5d-9e3afc2dc8d8" released by "delete_volume" :: held 0.870s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:59 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.info Sep 05 20:59:59 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:59 devstack cinder-volume[87802]: WARNING cinder.quota [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-178121808-626551437 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-178121808-626551437, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:59 devstack cinder-volume[87802]: WARNING cinder.quota [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-178121808-626551437 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-178121808-626551437, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Created reservations ['96a300f9-3c38-4594-a841-b10787b7091a', 'f5b957fc-7810-44d8-9547-63e1106b255b', '1f53b9e2-cc27-485c-8474-70a8e114b0a2', '7c219e3c-3fc2-46e6-bc8c-6449f69c255a'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:59 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 20:59:59 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:59 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.info" returned: 0 in 0.409s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:59 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.info is being set with open permissions: ugo+rw Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:59 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.info Sep 05 20:59:59 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:59 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.371s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Deleted volume successfully. Sep 05 20:59:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8d39143c-9a5c-48ef-b6d6-263c705fd4b2 tempest-TestInstancesWithCinderVolumes-573937096 None] Lock "cinder-d893227c-c798-4560-8e5d-9e3afc2dc8d8-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:00 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.info" returned: 0 in 0.373s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ca762d9a-ba89-42b4-a960-dde1aeb2bb4a tempest-VolumesSnapshotTestJSON-1939433628 None] Create snapshot completed successfully Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (60e6b4ba-d8c5-4a01-9c48-a8fe89cb6fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3bb219-e1aa-477c-8bcf-1eaaea60169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3bb219-e1aa-477c-8bcf-1eaaea60169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1857050124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=facc6760-a61a-427b-9936-a65d070d88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc3e719a5994141b3b3d053a9f4cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:01Z,use_quota=True,user_id='ee466a7ca9a8475fa2d2e9badd81d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8730ac-24e9-4a73-b9dc-c8eeec5f19cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8730ac-24e9-4a73-b9dc-c8eeec5f19cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961f4f26-7e29-4a54-b87e-069135ebc12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961f4f26-7e29-4a54-b87e-069135ebc12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'facc6760-a61a-427b-9936-a65d070d88a8', 'volume_name': 'volume-facc6760-a61a-427b-9936-a65d070d88a8', 'volume_size': 1, 'snapshot_id': '78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8f5a73-47ea-447f-936f-33fbddafdbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8f5a73-47ea-447f-936f-33fbddafdbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f955c46-a89d-4714-9b96-3c22ce0ca602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Volume facc6760-a61a-427b-9936-a65d070d88a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-facc6760-a61a-427b-9936-a65d070d88a8', 'volume_size': 1, 'snapshot_id': '78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8'} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8-facc6760-a61a-427b-9936-a65d070d88a8" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8-facc6760-a61a-427b-9936-a65d070d88a8" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Creating volume facc6760-a61a-427b-9936-a65d070d88a8 from snapshot 78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-facc6760-a61a-427b-9936-a65d070d88a8" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-facc6760-a61a-427b-9936-a65d070d88a8" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] snapshot: 78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8, volume: facc6760-a61a-427b-9936-a65d070d88a8, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a0582f-1e5e-4ed1-a312-8064da9c6fb3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:01 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 Sep 05 21:00:01 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Flow 'volume_create_manager' (76459290-54cb-459b-9834-2fa6d4f3246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e797ed2c-76ea-4326-a841-ac99677786dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e797ed2c-76ea-4326-a841-ac99677786dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1416317677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68aa0834-730e-4225-aad0-ffb24b02bc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0157d0642a6d426c8cd28f401bd33186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:02Z,use_quota=True,user_id='ab077b5054bb48a1894fc1598271c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479a53a8-6e8e-42fc-97f0-4b2e8f36155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479a53a8-6e8e-42fc-97f0-4b2e8f36155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0195fc57-4d6f-4568-8a8d-84a89d77226f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0195fc57-4d6f-4568-8a8d-84a89d77226f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68aa0834-730e-4225-aad0-ffb24b02bc2e', 'volume_name': 'volume-68aa0834-730e-4225-aad0-ffb24b02bc2e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce69819-3757-4eba-91d3-8f4da874b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce69819-3757-4eba-91d3-8f4da874b349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f4a90e-e794-426e-9abb-ba3d196780b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:01 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Volume 68aa0834-730e-4225-aad0-ffb24b02bc2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68aa0834-730e-4225-aad0-ffb24b02bc2e', 'volume_size': 1} Sep 05 21:00:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:02 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" returned: 0 in 0.541s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc3046a-1bf2-4979-9e9b-aec9ffcbf112]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:02 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 Sep 05 21:00:02 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:02 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" returned: 0 in 0.438s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:00:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:02 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 Sep 05 21:00:02 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:08 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8" returned: 0 in 5.530s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:00:08 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Converted 1024.00 MB image at 185.13 MB/s Sep 05 21:00:08 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 is being set with open permissions: ugo+rw Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:08 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 Sep 05 21:00:08 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:08 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8" returned: 0 in 0.283s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-facc6760-a61a-427b-9936-a65d070d88a8" released by "_copy_volume_from_snapshot" :: held 6.912s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8-facc6760-a61a-427b-9936-a65d070d88a8" released by "_create_volume_from_snapshot" :: held 7.003s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.029s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.458s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1416317677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68aa0834-730e-4225-aad0-ffb24b02bc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0157d0642a6d426c8cd28f401bd33186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:02Z,use_quota=True,user_id='ab077b5054bb48a1894fc1598271c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Creating volume 68aa0834-730e-4225-aad0-ffb24b02bc2e {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:08 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:08 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e 1073741824 Sep 05 21:00:08 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f955c46-a89d-4714-9b96-3c22ce0ca602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-facc6760-a61a-427b-9936-a65d070d88a8', 'volume_size': 1, 'snapshot_id': '78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f4357b-0fa5-456d-b0bd-6cc9361fb6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:08 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Volume volume-facc6760-a61a-427b-9936-a65d070d88a8 (facc6760-a61a-427b-9936-a65d070d88a8): created successfully Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f4357b-0fa5-456d-b0bd-6cc9361fb6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Flow 'volume_create_manager' (60e6b4ba-d8c5-4a01-9c48-a8fe89cb6fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:08 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-da0416f9-9b9b-4872-bd3f-e2a6fde3dd0c tempest-VolumesSnapshotTestJSON-1939433628 None] Created volume successfully. Sep 05 21:00:08 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e 1073741824" returned: 0 in 0.539s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:09 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e Sep 05 21:00:09 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-facc6760-a61a-427b-9936-a65d070d88a8-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-facc6760-a61a-427b-9936-a65d070d88a8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-facc6760-a61a-427b-9936-a65d070d88a8" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-facc6760-a61a-427b-9936-a65d070d88a8" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:09 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e" returned: 0 in 0.425s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f97e87-771a-409a-aaa7-6b0153271698]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f4a90e-e794-426e-9abb-ba3d196780b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68aa0834-730e-4225-aad0-ffb24b02bc2e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672d0459-36cd-4fc6-bc5c-35daf6e2c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:09 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Volume volume-68aa0834-730e-4225-aad0-ffb24b02bc2e (68aa0834-730e-4225-aad0-ffb24b02bc2e): created successfully Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672d0459-36cd-4fc6-bc5c-35daf6e2c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Flow 'volume_create_manager' (76459290-54cb-459b-9834-2fa6d4f3246f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:09 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-13d31cd5-99f3-4478-9b7e-d9e163ebf912 tempest-AbsoluteLimitsTests-1507959875 None] Created volume successfully. Sep 05 21:00:09 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 Sep 05 21:00:09 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:09 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8" returned: 0 in 0.509s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:10 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8 Sep 05 21:00:10 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Acquiring lock "cinder-68aa0834-730e-4225-aad0-ffb24b02bc2e-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:10 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-facc6760-a61a-427b-9936-a65d070d88a8" returned: 0 in 0.363s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Lock "cinder-68aa0834-730e-4225-aad0-ffb24b02bc2e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-facc6760-a61a-427b-9936-a65d070d88a8" released by "delete_volume" :: held 0.948s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Acquiring lock "cinder-quobyte-68aa0834-730e-4225-aad0-ffb24b02bc2e" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Lock "cinder-quobyte-68aa0834-730e-4225-aad0-ffb24b02bc2e" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Created reservations ['0d8dad6d-6d21-458a-a853-8572fca01918', '4e47b6d7-b745-4fe8-b446-7808ec992db7', '6c5bb0f4-68ef-4fc7-9061-5ceaeae06c1e', '3dac744a-06fb-4892-a4ee-dda05dcac360'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fda906-ec62-4ae7-8864-da717027f863]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:10 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:10 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:10 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e Sep 05 21:00:10 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:10 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.317s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:10 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e" returned: 0 in 0.421s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:10 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Deleted volume successfully. Sep 05 21:00:10 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e Sep 05 21:00:10 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-67d78aad-5718-425e-9aa2-d6f26f683cc3 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-facc6760-a61a-427b-9936-a65d070d88a8-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:11 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68aa0834-730e-4225-aad0-ffb24b02bc2e" returned: 0 in 0.270s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Lock "cinder-quobyte-68aa0834-730e-4225-aad0-ffb24b02bc2e" released by "delete_volume" :: held 0.764s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Created reservations ['2be3b65f-e5aa-41d1-8354-1ebddeb5bab5', '8d645621-e67a-41aa-8e73-376a043795a7', 'a2ad569e-ad28-4a0a-b5a2-cad8f45bd5b6', '200c37c9-4cbf-4bf2-89ef-25000111ee29'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:11 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:11 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:11 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.319s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:11 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Deleted volume successfully. Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-21d6c67f-55f2-4554-849b-63cc6591b9fe tempest-AbsoluteLimitsTests-1507959875 None] Lock "cinder-68aa0834-730e-4225-aad0-ffb24b02bc2e-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Deleting offline snapshot 78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 of volume 0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] snapshot_file for this snap is: volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:00:11 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (b41dbe88-6c99-49a0-8e9d-cfada2d226aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b83b86-bafa-4b8f-b190-1d9699464c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[979bd651-c7f6-45bc-b846-7ce8cd83293a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b83b86-bafa-4b8f-b190-1d9699464c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059404225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f2bc6b-129d-4601-89be-0ef302a10b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:12Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec2f4b-b011-43f9-a864-949c8d479ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec2f4b-b011-43f9-a864-949c8d479ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d2ee5f-0252-4cd8-af68-0e0684022395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d2ee5f-0252-4cd8-af68-0e0684022395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f2bc6b-129d-4601-89be-0ef302a10b3d', 'volume_name': 'volume-39f2bc6b-129d-4601-89be-0ef302a10b3d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21416c8c-2c3c-4a88-994d-233b620cc6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21416c8c-2c3c-4a88-994d-233b620cc6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6096ef0-4ce1-402e-80c0-433440a43a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Volume 39f2bc6b-129d-4601-89be-0ef302a10b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f2bc6b-129d-4601-89be-0ef302a10b3d', 'volume_size': 1} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059404225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f2bc6b-129d-4601-89be-0ef302a10b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:12Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Creating volume 39f2bc6b-129d-4601-89be-0ef302a10b3d {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:12 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:12 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d 1073741824 Sep 05 21:00:12 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:12 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 Sep 05 21:00:12 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (1d62a0dd-61e9-4743-a238-1252c3869807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1768e648-a859-4fbd-99f5-d829dcddee9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1768e648-a859-4fbd-99f5-d829dcddee9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-484276299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad4ff18-10b3-4247-aa0f-6ece2781e12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:12Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b2a009-3d23-4249-8216-8ae3bd2a6763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b2a009-3d23-4249-8216-8ae3bd2a6763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669d1f8f-b2f0-495c-a56b-1da164b1f06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669d1f8f-b2f0-495c-a56b-1da164b1f06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad4ff18-10b3-4247-aa0f-6ece2781e12d', 'volume_name': 'volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7edcc12-7897-4c8a-b2da-b12e2c81f22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7edcc12-7897-4c8a-b2da-b12e2c81f22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a938f4b3-c2a7-4322-9921-4e5299415be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:12 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Volume 3ad4ff18-10b3-4247-aa0f-6ece2781e12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d', 'volume_size': 1} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" returned: 0 in 0.576s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665fb76-cd3a-4971-b506-978e12c78320]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:12 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d 1073741824" returned: 0 in 0.870s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:13 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 Sep 05 21:00:13 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:13 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d Sep 05 21:00:13 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (f177a4ea-51ac-4bb9-9677-f6046b6caf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fb9de9-8011-45da-90cf-9ba869e8581c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fb9de9-8011-45da-90cf-9ba869e8581c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27540657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:13Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b4886-1751-4987-8ceb-85d8b73dafc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b4886-1751-4987-8ceb-85d8b73dafc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5870aed3-baeb-4cb7-95c9-1a5a7e9cab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5870aed3-baeb-4cb7-95c9-1a5a7e9cab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7', 'volume_name': 'volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691ce738-107b-4629-8318-c0a00aec6b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691ce738-107b-4629-8318-c0a00aec6b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe62292-3754-43ef-85b5-c5ba0cd00c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:13 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Volume 0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7', 'volume_size': 1} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:13 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d" returned: 0 in 0.353s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-484276299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad4ff18-10b3-4247-aa0f-6ece2781e12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:12Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Creating volume 3ad4ff18-10b3-4247-aa0f-6ece2781e12d {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:13 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:13 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d 1073741824 Sep 05 21:00:13 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6096ef0-4ce1-402e-80c0-433440a43a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f2bc6b-129d-4601-89be-0ef302a10b3d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc5983d-74b2-43d7-8b10-dbdc8dd71f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:13 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Volume volume-39f2bc6b-129d-4601-89be-0ef302a10b3d (39f2bc6b-129d-4601-89be-0ef302a10b3d): created successfully Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc5983d-74b2-43d7-8b10-dbdc8dd71f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (b41dbe88-6c99-49a0-8e9d-cfada2d226aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:13 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-32dc0ba4-4ec3-49ee-aadf-2b56b51c92d3 tempest-CreateVolumesFromImageTest-850543002 None] Created volume successfully. Sep 05 21:00:13 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" returned: 0 in 1.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:14 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 Sep 05 21:00:14 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (d978a8c2-6ebb-42e5-8d15-3f54650de5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c0c8fc-0785-4c56-84cb-8ac257185950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c0c8fc-0785-4c56-84cb-8ac257185950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-649144537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a34b6e-0032-438d-9039-5fc3e5f675c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:14Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ecd1bf-534a-4fc4-a646-63b8788afc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ecd1bf-534a-4fc4-a646-63b8788afc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86a6fbc-1215-4d39-b437-d3f958fd69e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86a6fbc-1215-4d39-b437-d3f958fd69e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a34b6e-0032-438d-9039-5fc3e5f675c9', 'volume_name': 'volume-52a34b6e-0032-438d-9039-5fc3e5f675c9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdaf988-fdff-48cb-9fdb-1275afd6fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdaf988-fdff-48cb-9fdb-1275afd6fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2259d4-b26f-4975-b920-5b2b473ac9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Volume 52a34b6e-0032-438d-9039-5fc3e5f675c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a34b6e-0032-438d-9039-5fc3e5f675c9', 'volume_size': 1} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:14 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d 1073741824" returned: 0 in 0.836s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:14 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d Sep 05 21:00:14 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (c591ad2e-3563-44e1-9530-a9bb5359e8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539d9b9e-0ed5-4843-9f54-7a59e8e0ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539d9b9e-0ed5-4843-9f54-7a59e8e0ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855058804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e19ebbc-c96e-4ddf-a77d-adcd1527a815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:15Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26abf1c5-e24b-40de-9d34-bf3bf95d56f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26abf1c5-e24b-40de-9d34-bf3bf95d56f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d290682f-2b93-45e2-a3c6-85050abb316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d290682f-2b93-45e2-a3c6-85050abb316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e19ebbc-c96e-4ddf-a77d-adcd1527a815', 'volume_name': 'volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9595c2-9176-4b1c-9fee-31d4d4065807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9595c2-9176-4b1c-9fee-31d4d4065807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed421ae-78d0-4354-9241-51bc31f24f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Volume 6e19ebbc-c96e-4ddf-a77d-adcd1527a815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815', 'volume_size': 1} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" returned: 0 in 0.724s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:14 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8 Sep 05 21:00:14 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:14 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d" returned: 0 in 0.371s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27540657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:13Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Creating volume 0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:14 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:14 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 1073741824 Sep 05 21:00:14 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a938f4b3-c2a7-4322-9921-4e5299415be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b5aadd-be43-478f-9b33-08e21676f432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:14 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Volume volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d (3ad4ff18-10b3-4247-aa0f-6ece2781e12d): created successfully Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b5aadd-be43-478f-9b33-08e21676f432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (1d62a0dd-61e9-4743-a238-1252c3869807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:14 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-53d26187-f443-431c-89fa-fda2ddca5913 tempest-CreateVolumesFromImageTest-850543002 None] Created volume successfully. Sep 05 21:00:15 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402.78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" returned: 0 in 0.470s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8" released by "_delete_snapshot" :: held 3.301s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" released by "delete_snapshot" :: held 3.341s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Created reservations ['c14a33fb-a249-4c74-a2d3-ebc0c45fefd0', '72712cbc-d129-4367-b0da-de518b887297', 'c4af81cd-0b67-4369-8a6d-4f3521aa1b9d', 'e0441e9e-1585-440c-9a4c-f8f71a961dbc'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:15 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Delete snapshot completed successfully. Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f19a916-035c-46bf-91be-4affd61bbb05 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-78b92d2b-d32c-4fb7-9d59-55f5fdaa82e8-delete_snapshot" released by "delete_snapshot" :: held 3.583s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:15 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 1073741824" returned: 0 in 0.792s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:15 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 Sep 05 21:00:15 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:15 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7" returned: 0 in 0.285s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-649144537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a34b6e-0032-438d-9039-5fc3e5f675c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:14Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Creating volume 52a34b6e-0032-438d-9039-5fc3e5f675c9 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:15 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe62292-3754-43ef-85b5-c5ba0cd00c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:15 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369ac551-dd23-4877-bb11-4dc34635db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:15 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 1073741824 Sep 05 21:00:15 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:16 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Volume volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 (0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7): created successfully Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369ac551-dd23-4877-bb11-4dc34635db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (f177a4ea-51ac-4bb9-9677-f6046b6caf1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-368a2604-f1ba-4dad-9581-497bce8a9270 tempest-CreateVolumesFromImageTest-850543002 None] Created volume successfully. Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" acquired by "delete_volume" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5238d5d0-73de-4570-bb9b-43475df211a5]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:16 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 1073741824" returned: 0 in 0.691s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:16 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 Sep 05 21:00:16 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:16 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 Sep 05 21:00:16 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:17 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9" returned: 0 in 0.352s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.335s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855058804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e19ebbc-c96e-4ddf-a77d-adcd1527a815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179ab7db11c84071a45b53440d7245b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:15Z,use_quota=True,user_id='6ac65391b3234253860ecef0d79a1d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Creating volume 6e19ebbc-c96e-4ddf-a77d-adcd1527a815 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:17 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:17 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 1073741824 Sep 05 21:00:17 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2259d4-b26f-4975-b920-5b2b473ac9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a34b6e-0032-438d-9039-5fc3e5f675c9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ecb694-30f0-4240-95b3-8078ddcb0136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:17 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Volume volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 (52a34b6e-0032-438d-9039-5fc3e5f675c9): created successfully Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ecb694-30f0-4240-95b3-8078ddcb0136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (d978a8c2-6ebb-42e5-8d15-3f54650de5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:17 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" returned: 0 in 0.566s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:17 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-959fc081-08da-4f32-ae4d-a5dcf2a93a15 tempest-CreateVolumesFromImageTest-850543002 None] Created volume successfully. Sep 05 21:00:17 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402 Sep 05 21:00:17 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:17 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" returned: 0 in 0.324s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402" released by "delete_volume" :: held 0.995s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Created reservations ['c6ce38b1-b513-4a0f-b687-7f8d37f43303', 'b2266e4f-9721-405f-87d1-8a6db4470222', 'ad2d7b43-d8e2-4bc4-9140-53a3c2bf1cc2', 'd3ce5976-3c96-428a-8629-eb8505dc5812'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:17 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:17 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:17 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 1073741824" returned: 0 in 0.667s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:17 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 Sep 05 21:00:17 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:18 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.401s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:18 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815" returned: 0 in 0.317s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Deleted volume successfully. Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed421ae-78d0-4354-9241-51bc31f24f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d91d799-89a2-4859-bf37-d9e15a693cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:18 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Volume volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 (6e19ebbc-c96e-4ddf-a77d-adcd1527a815): created successfully Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d91d799-89a2-4859-bf37-d9e15a693cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Flow 'volume_create_manager' (c591ad2e-3563-44e1-9530-a9bb5359e8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d18304a6-9d00-4733-9424-3e38f630e47a tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-0a1a88c1-03cb-4885-9ad0-a2f2c8e87402-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-381736c4-13f1-4ca3-b5e5-1e8a8c71c1c1 tempest-CreateVolumesFromImageTest-850543002 None] Created volume successfully. Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-ae3191b0-bf03-44e3-b394-3d8ed434ec95-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-ae3191b0-bf03-44e3-b394-3d8ed434ec95-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "cinder-quobyte-ae3191b0-bf03-44e3-b394-3d8ed434ec95" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-ae3191b0-bf03-44e3-b394-3d8ed434ec95" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ca9e44-8a2c-4a8a-97f6-839efde05875]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:19 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 Sep 05 21:00:19 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-6e19ebbc-c96e-4ddf-a77d-adcd1527a815-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-6e19ebbc-c96e-4ddf-a77d-adcd1527a815-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-quobyte-6e19ebbc-c96e-4ddf-a77d-adcd1527a815" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-6e19ebbc-c96e-4ddf-a77d-adcd1527a815" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3287bd97-6b8a-4d8c-b2be-12266b540978]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:19 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95" returned: 0 in 0.565s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:19 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95 Sep 05 21:00:19 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:19 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 Sep 05 21:00:19 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:19 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ae3191b0-bf03-44e3-b394-3d8ed434ec95" returned: 0 in 0.344s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-quobyte-ae3191b0-bf03-44e3-b394-3d8ed434ec95" released by "delete_volume" :: held 1.006s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:19 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Created reservations ['a91951d9-9779-4438-8879-1a6d46ff2cb2', '9b981408-8f93-43a9-bebb-5d0046897d38', '98f8a8d6-6ff9-41ed-a939-bdc8d6c9036a', '88896441-e3b1-40e1-bbd2-657db754fbd3'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:20 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815" returned: 0 in 0.674s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:20 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:20 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:20 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815 Sep 05 21:00:20 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:20 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.450s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Deleted volume successfully. Sep 05 21:00:20 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e19ebbc-c96e-4ddf-a77d-adcd1527a815" returned: 0 in 0.476s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-6e19ebbc-c96e-4ddf-a77d-adcd1527a815" released by "delete_volume" :: held 1.224s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f581bf4-7b1a-4de3-b29f-1e8d7f709a29 tempest-VolumesSnapshotTestJSON-1939433628 None] Lock "cinder-ae3191b0-bf03-44e3-b394-3d8ed434ec95-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (6dc0ff14-fb20-4083-9b21-8265c1836120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e03966c-a1be-489f-a1c2-1ee693be5abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e03966c-a1be-489f-a1c2-1ee693be5abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1021020404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e95e59f-ef46-4a57-8d42-faf611665731,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:21Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f858b8-dc1f-424a-9fcb-abc7f70a2d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f858b8-dc1f-424a-9fcb-abc7f70a2d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afcf838-660c-4bf6-b595-b8c26c8d92ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afcf838-660c-4bf6-b595-b8c26c8d92ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e95e59f-ef46-4a57-8d42-faf611665731', 'volume_name': 'volume-6e95e59f-ef46-4a57-8d42-faf611665731', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dea2e21-433e-494d-9e98-50ddc15acdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dea2e21-433e-494d-9e98-50ddc15acdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9142ab32-88cf-4d54-8f9c-6da5978b663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:20 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Volume 6e95e59f-ef46-4a57-8d42-faf611665731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e95e59f-ef46-4a57-8d42-faf611665731', 'volume_size': 1} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1021020404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e95e59f-ef46-4a57-8d42-faf611665731,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:21Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Creating volume 6e95e59f-ef46-4a57-8d42-faf611665731 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:20 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:20 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 1073741824 Sep 05 21:00:20 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Created reservations ['fddd399a-8c11-4409-9019-f4400141db0f', '20ab6bc9-832a-44e7-9fbc-1ec260bde51e', '6f629ee9-c662-4803-ae4c-9b5c58b5b30c', 'bf600e2d-600a-4c5e-b90a-8dc3f9ef92ff'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=145,cinder:SELECT=140,cinder:INSERT=39,cinder:DELETE=9 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:20 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:20 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:21 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.298s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:21 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Deleted volume successfully. Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-81fc2fe5-c1f4-47b1-8207-a7d8918baba4 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-6e19ebbc-c96e-4ddf-a77d-adcd1527a815-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:21 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 1073741824" returned: 0 in 0.585s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=135,cinder:UPDATE=169,cinder:DELETE=18,cinder:INSERT=37 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:21 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 Sep 05 21:00:21 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-52a34b6e-0032-438d-9039-5fc3e5f675c9-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:21 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731" returned: 0 in 0.325s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-52a34b6e-0032-438d-9039-5fc3e5f675c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9142ab32-88cf-4d54-8f9c-6da5978b663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e95e59f-ef46-4a57-8d42-faf611665731', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03c0707-9080-47cc-bbcf-e4421879c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:21 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Volume volume-6e95e59f-ef46-4a57-8d42-faf611665731 (6e95e59f-ef46-4a57-8d42-faf611665731): created successfully Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03c0707-9080-47cc-bbcf-e4421879c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (6dc0ff14-fb20-4083-9b21-8265c1836120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:21 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c8f0a68d-19f0-488f-a321-516d80ae0352 tempest-VolumesGetTest-1278876383 None] Created volume successfully. Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-quobyte-52a34b6e-0032-438d-9039-5fc3e5f675c9" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-52a34b6e-0032-438d-9039-5fc3e5f675c9" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d0698-3f52-49bc-8960-af21c2dc4d3c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:21 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 Sep 05 21:00:21 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:22 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9" returned: 0 in 0.438s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:22 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9 Sep 05 21:00:22 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:22 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-52a34b6e-0032-438d-9039-5fc3e5f675c9" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-52a34b6e-0032-438d-9039-5fc3e5f675c9" released by "delete_volume" :: held 0.807s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Created reservations ['5e91377b-544d-47ec-8de7-1e0e9a6c105b', 'bc344bc6-df9e-4acb-ac5f-edb3666a57c9', 'a82f6fc9-4c87-479a-a49c-052ead03f057', 'baea70c0-9c55-401a-b738-b06aa3e87132'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:22 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:22 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-quobyte-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e583fcd-d7a0-43e6-b227-9ca83e37a070]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:23 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.383s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Deleted volume successfully. Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6a600d71-3bdc-46a9-8b58-501abe4e7146 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-52a34b6e-0032-438d-9039-5fc3e5f675c9-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:23 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 Sep 05 21:00:23 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:23 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7" returned: 0 in 0.582s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:23 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7 Sep 05 21:00:23 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (f5213a75-e577-4b99-9b1e-ade1928b9c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec0cc1e-6c8b-4514-9dad-d08339f9d806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec0cc1e-6c8b-4514-9dad-d08339f9d806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2031925653',display_name='tempest-VolumesGetTest-Volume-1726966448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f44875-cf9b-4b40-afd9-55af26bd757a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:24Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac28f56b-05a6-4d40-bdf9-74c539f3ea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac28f56b-05a6-4d40-bdf9-74c539f3ea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908d6b31-bfed-4676-a046-49f8644963ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908d6b31-bfed-4676-a046-49f8644963ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f44875-cf9b-4b40-afd9-55af26bd757a', 'volume_name': 'volume-61f44875-cf9b-4b40-afd9-55af26bd757a', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f58659-ec11-47c5-b69b-fc30936af183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f58659-ec11-47c5-b69b-fc30936af183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de48fee-729a-44b4-9d93-77f98c7cbd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Volume 61f44875-cf9b-4b40-afd9-55af26bd757a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f44875-cf9b-4b40-afd9-55af26bd757a', 'volume_size': 1} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2031925653',display_name='tempest-VolumesGetTest-Volume-1726966448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f44875-cf9b-4b40-afd9-55af26bd757a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:24Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Creating volume 61f44875-cf9b-4b40-afd9-55af26bd757a {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:24 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:24 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:24 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a 1073741824 Sep 05 21:00:24 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7" returned: 0 in 0.365s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7" released by "delete_volume" :: held 1.029s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Created reservations ['3351190f-d6e3-4e50-9230-b4a6f56cd180', '772637bd-cdd6-4db1-bc7b-2a943229ed79', 'aded0cee-b71e-4be5-a900-d405aab34acb', '7ec70ab7-09dc-4083-bfc0-2c34ae6b4c34'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:24 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:24 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:24 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.354s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:24 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Deleted volume successfully. Sep 05 21:00:24 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a 1073741824" returned: 0 in 0.678s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-acebeab2-83fb-4d93-aa50-906a96281300 tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-0ce0677b-1f42-4f7f-b13e-c016ea6cc1e7-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:24 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a Sep 05 21:00:24 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:25 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a" returned: 0 in 0.289s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de48fee-729a-44b4-9d93-77f98c7cbd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f44875-cf9b-4b40-afd9-55af26bd757a', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a156c65-e2c6-41b4-ab5d-777f7282748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:25 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Volume volume-61f44875-cf9b-4b40-afd9-55af26bd757a (61f44875-cf9b-4b40-afd9-55af26bd757a): created successfully Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a156c65-e2c6-41b4-ab5d-777f7282748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (f5213a75-e577-4b99-9b1e-ade1928b9c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:25 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-53a0d866-14aa-464f-8da0-e98050f85502 tempest-VolumesGetTest-1278876383 None] Created volume successfully. Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-3ad4ff18-10b3-4247-aa0f-6ece2781e12d-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-3ad4ff18-10b3-4247-aa0f-6ece2781e12d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-quobyte-3ad4ff18-10b3-4247-aa0f-6ece2781e12d" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-3ad4ff18-10b3-4247-aa0f-6ece2781e12d" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6229703e-cfc3-4a28-8478-65834fe097f7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:25 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d Sep 05 21:00:25 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:25 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d" returned: 0 in 0.437s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:25 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d Sep 05 21:00:25 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:26 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ad4ff18-10b3-4247-aa0f-6ece2781e12d" returned: 0 in 0.413s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-3ad4ff18-10b3-4247-aa0f-6ece2781e12d" released by "delete_volume" :: held 0.913s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-61f44875-cf9b-4b40-afd9-55af26bd757a-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Lock "cinder-61f44875-cf9b-4b40-afd9-55af26bd757a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Created reservations ['3b1c598b-d79f-4f5b-95f0-82d89ed3c708', '9d8c9a59-c6e2-425c-9aae-9014f8bad308', '18ba0db8-cd2b-4e4c-ac49-8671f432263a', 'd6eec1f6-cc88-45e0-86f6-4b4aa59620ad'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-61f44875-cf9b-4b40-afd9-55af26bd757a" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-61f44875-cf9b-4b40-afd9-55af26bd757a" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef1276d-ddb7-4818-97bb-563149b89aaa]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:26 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:26 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:26 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a Sep 05 21:00:26 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:26 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.342s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:26 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Deleted volume successfully. Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62954120-e1d0-4dc5-add5-93da4b44042d tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-3ad4ff18-10b3-4247-aa0f-6ece2781e12d-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:27 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a" returned: 0 in 0.557s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:27 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a Sep 05 21:00:27 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:27 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-61f44875-cf9b-4b40-afd9-55af26bd757a" returned: 0 in 0.340s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-61f44875-cf9b-4b40-afd9-55af26bd757a" released by "delete_volume" :: held 0.972s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Created reservations ['d2ddab6a-eeb9-48dc-b406-885742e67227', 'd4bea5d5-e34c-4e5f-afb1-5e2a8d7ec8e3', 'effba973-4466-45e2-a254-cbc19d79bd63', '01d127d9-edc1-4b20-a2a9-49893132cb07'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-39f2bc6b-129d-4601-89be-0ef302a10b3d-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:27 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:27 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-39f2bc6b-129d-4601-89be-0ef302a10b3d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "cinder-quobyte-39f2bc6b-129d-4601-89be-0ef302a10b3d" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-39f2bc6b-129d-4601-89be-0ef302a10b3d" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1f2999-f808-4fce-bb98-8b062aedaca5]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:28 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:28 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d Sep 05 21:00:28 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Deleted volume successfully. Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6df97f83-ce01-4095-84b2-24a56c965046 tempest-VolumesGetTest-1278876383 None] Lock "cinder-61f44875-cf9b-4b40-afd9-55af26bd757a-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:28 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d" returned: 0 in 0.486s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:28 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d Sep 05 21:00:28 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:28 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-39f2bc6b-129d-4601-89be-0ef302a10b3d" returned: 0 in 0.343s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-quobyte-39f2bc6b-129d-4601-89be-0ef302a10b3d" released by "delete_volume" :: held 0.897s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-6e95e59f-ef46-4a57-8d42-faf611665731-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Lock "cinder-6e95e59f-ef46-4a57-8d42-faf611665731-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Created reservations ['98321a7f-d03f-446b-848c-c6df8b45b9a7', '6d2a15f1-0285-4e95-850a-82370b358903', '1ff8e325-3ca0-4d4a-a860-18641906997f', '547671d7-4f9d-4ad3-bf2f-9e4c85c6b7ab'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-6e95e59f-ef46-4a57-8d42-faf611665731" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-6e95e59f-ef46-4a57-8d42-faf611665731" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada35e8d-fb56-4f1d-bbc9-2fb3f0ebdb56]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:29 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:29 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:29 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 Sep 05 21:00:29 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:29 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.408s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Deleted volume successfully. Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-501a6229-ea33-41fe-aa92-c4d4019a158a tempest-CreateVolumesFromImageTest-850543002 None] Lock "cinder-39f2bc6b-129d-4601-89be-0ef302a10b3d-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:29 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731" returned: 0 in 0.637s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:29 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731 Sep 05 21:00:29 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:30 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6e95e59f-ef46-4a57-8d42-faf611665731" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-6e95e59f-ef46-4a57-8d42-faf611665731" released by "delete_volume" :: held 1.119s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Created reservations ['a7d8476c-22fe-43fd-b3d3-1f382c11de85', 'c6ea85c9-be4d-4b27-aa65-0cd50ebebe4c', '20b09f3e-757d-4472-802d-9bf34ff02415', 'f59ac73c-d92a-4f16-9646-9e5eb2b97e1d'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:30 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:30 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:30 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Deleted volume successfully. Sep 05 21:00:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6f4cbac0-35fe-45b9-9603-bf9718662c4b tempest-VolumesGetTest-1278876383 None] Lock "cinder-6e95e59f-ef46-4a57-8d42-faf611665731-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (02ca5eba-c38c-40b6-85a4-062c68ff263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb6a75c-ef1a-4497-8eab-711706756cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb6a75c-ef1a-4497-8eab-711706756cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1597423241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba66439-74c6-4a25-8637-68898048afdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:32Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefc2d96-aae3-492c-80bb-18c12124f83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefc2d96-aae3-492c-80bb-18c12124f83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0161bc62-3071-4e58-9ed6-dbe43faede0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0161bc62-3071-4e58-9ed6-dbe43faede0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba66439-74c6-4a25-8637-68898048afdb', 'volume_name': 'volume-eba66439-74c6-4a25-8637-68898048afdb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d28466-6318-4b2a-8409-2f0d63526b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d28466-6318-4b2a-8409-2f0d63526b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e056be7-5658-4348-b770-5bc10bd52227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:32 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Volume eba66439-74c6-4a25-8637-68898048afdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba66439-74c6-4a25-8637-68898048afdb', 'volume_size': 1} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1597423241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba66439-74c6-4a25-8637-68898048afdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:32Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Creating volume eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:32 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:32 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb 1073741824 Sep 05 21:00:32 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:32 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb 1073741824" returned: 0 in 0.675s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Flow 'volume_create_manager' (2e728384-023c-4cf5-8857-c35fbab7422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455546b0-d221-40df-913d-5c6e4ad70eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455546b0-d221-40df-913d-5c6e4ad70eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-181779318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843877a1-f94b-4321-9572-83edb44f03f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74fb3e05494877a9b1c602af1d174c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:33Z,use_quota=True,user_id='5660cee3db2b49a99a7a9878d4a282e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6c55af-0f7f-4657-b9b7-29433f8f8a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6c55af-0f7f-4657-b9b7-29433f8f8a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ad7779-eb5a-4182-8b95-5c9aedbc9a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ad7779-eb5a-4182-8b95-5c9aedbc9a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843877a1-f94b-4321-9572-83edb44f03f1', 'volume_name': 'volume-843877a1-f94b-4321-9572-83edb44f03f1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea87996a-514d-419e-a50e-e9e5b72b0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea87996a-514d-419e-a50e-e9e5b72b0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3cb164-6561-4282-bd98-d6962f9d85e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:33 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Volume 843877a1-f94b-4321-9572-83edb44f03f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843877a1-f94b-4321-9572-83edb44f03f1', 'volume_size': 1} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:33 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb Sep 05 21:00:33 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:33 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb" returned: 0 in 0.378s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.411s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-181779318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843877a1-f94b-4321-9572-83edb44f03f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74fb3e05494877a9b1c602af1d174c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:33Z,use_quota=True,user_id='5660cee3db2b49a99a7a9878d4a282e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Creating volume 843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:33 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e056be7-5658-4348-b770-5bc10bd52227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba66439-74c6-4a25-8637-68898048afdb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca86f209-d1cd-4347-9c9a-10053fb3f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:33 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 1073741824 Sep 05 21:00:33 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:33 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Volume volume-eba66439-74c6-4a25-8637-68898048afdb (eba66439-74c6-4a25-8637-68898048afdb): created successfully Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca86f209-d1cd-4347-9c9a-10053fb3f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (02ca5eba-c38c-40b6-85a4-062c68ff263a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:33 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-cc9f0358-dbb0-4b88-ba11-b93ca6e09040 tempest-VolumesGetTest-1278876383 None] Created volume successfully. Sep 05 21:00:34 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 1073741824" returned: 0 in 0.721s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:34 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 Sep 05 21:00:34 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:34 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1" returned: 0 in 0.686s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3cb164-6561-4282-bd98-d6962f9d85e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843877a1-f94b-4321-9572-83edb44f03f1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95235256-cca9-4e16-9f49-e6015d1729a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Volume volume-843877a1-f94b-4321-9572-83edb44f03f1 (843877a1-f94b-4321-9572-83edb44f03f1): created successfully Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95235256-cca9-4e16-9f49-e6015d1729a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Flow 'volume_create_manager' (2e728384-023c-4cf5-8857-c35fbab7422e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3adc21c8-ee59-4d71-a1bb-e6552ead845d tempest-VolumesSnapshotListTestJSON-1893540689 None] Created volume successfully. Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (abaa7c99-d13b-4ad0-a949-5134300b9de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dddf526-abcd-410f-a809-bba3408f4636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dddf526-abcd-410f-a809-bba3408f4636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-754032832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190a282a-b997-4e70-b099-845520d911fb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=eba66439-74c6-4a25-8637-68898048afdb,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:35Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b4ae5b-c17b-4118-a048-c2fc5cea9131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b4ae5b-c17b-4118-a048-c2fc5cea9131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57d68df-260f-4e0d-be9d-4904f0ef0d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57d68df-260f-4e0d-be9d-4904f0ef0d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '190a282a-b997-4e70-b099-845520d911fb', 'volume_name': 'volume-190a282a-b997-4e70-b099-845520d911fb', 'volume_size': 1, 'source_volid': 'eba66439-74c6-4a25-8637-68898048afdb', 'source_volstatus': 'available'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe978b3-78c7-4fbc-9519-1e8979bd4bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe978b3-78c7-4fbc-9519-1e8979bd4bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3606842c-f7cd-446e-aa8e-7902e4a97832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Volume 190a282a-b997-4e70-b099-845520d911fb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-190a282a-b997-4e70-b099-845520d911fb', 'volume_size': 1, 'source_volid': 'eba66439-74c6-4a25-8637-68898048afdb', 'source_volstatus': 'available'} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:35 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Cloning volume eba66439-74c6-4a25-8637-68898048afdb to volume 190a282a-b997-4e70-b099-845520d911fb Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Flow 'volume_create_manager' (def67340-e485-430f-a66c-77a41d58c5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df78839-7914-4c63-851d-00b59954f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Creating offline snapshot 12b5bd4c-bb78-4a85-8d79-c633754f46e3 of volume eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df78839-7914-4c63-851d-00b59954f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1621719548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9426434-5e7c-4cec-966d-e7aec568c008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84775f7c46d84e3b9e445333c5fe0647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:36Z,use_quota=True,user_id='b377eac2f99b4d4c82a8cfc9ac62e1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539a1845-93ab-4948-9f41-dd1d2727fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539a1845-93ab-4948-9f41-dd1d2727fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fdce46-8a66-4508-b539-d8711d7b78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fdce46-8a66-4508-b539-d8711d7b78ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9426434-5e7c-4cec-966d-e7aec568c008', 'volume_name': 'volume-d9426434-5e7c-4cec-966d-e7aec568c008', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b23fc1c-1516-44a3-94f7-6bcb4ca3e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b23fc1c-1516-44a3-94f7-6bcb4ca3e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69a47ec-3e54-49e6-a5c1-5cc40c39b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Volume d9426434-5e7c-4cec-966d-e7aec568c008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9426434-5e7c-4cec-966d-e7aec568c008', 'volume_size': 1} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d490f-6942-4302-b84b-e0b5bc15aa96]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:36 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb Sep 05 21:00:36 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:36 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb" returned: 0 in 0.419s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:36 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 1G Sep 05 21:00:36 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:36 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 1G" returned: 0 in 0.512s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba66439-74c6-4a25-8637-68898048afdb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:36 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba66439-74c6-4a25-8637-68898048afdb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 Sep 05 21:00:36 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:37 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba66439-74c6-4a25-8637-68898048afdb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3" returned: 0 in 0.350s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:37 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 is being set with open permissions: ugo+rw Sep 05 21:00:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:37 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 Sep 05 21:00:37 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:37 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3" returned: 0 in 0.326s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:37 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.info Sep 05 21:00:37 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:37 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.info" returned: 0 in 0.302s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:37 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.info is being set with open permissions: ugo+rw Sep 05 21:00:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:37 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.info Sep 05 21:00:37 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:38 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.info" returned: 0 in 0.253s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-190a282a-b997-4e70-b099-845520d911fb" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-190a282a-b997-4e70-b099-845520d911fb" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] snapshot: 12b5bd4c-bb78-4a85-8d79-c633754f46e3, volume: 190a282a-b997-4e70-b099-845520d911fb, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0380766-bb84-47a5-ab08-32a76ef3410e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:38 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 Sep 05 21:00:38 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:38 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3" returned: 0 in 0.421s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eba66439-74c6-4a25-8637-68898048afdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[895c4b19-a7f1-41e4-a30d-e24c652cd0de]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:38 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb Sep 05 21:00:38 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:39 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb" returned: 0 in 0.433s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 21:00:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 21:00:39 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:00:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:39 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb Sep 05 21:00:39 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:44 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb" returned: 0 in 5.214s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:00:44 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Converted 1024.00 MB image at 196.36 MB/s Sep 05 21:00:44 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb is being set with open permissions: ugo+rw Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:44 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb Sep 05 21:00:44 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:44 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb" returned: 0 in 0.342s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-190a282a-b997-4e70-b099-845520d911fb" released by "_copy_volume_from_snapshot" :: held 6.486s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-12b5bd4c-bb78-4a85-8d79-c633754f46e3" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-12b5bd4c-bb78-4a85-8d79-c633754f46e3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Deleting offline snapshot 12b5bd4c-bb78-4a85-8d79-c633754f46e3 of volume eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] snapshot_file for this snap is: volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[272cbeba-7dd6-46d7-98c7-6447482da0b7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:44 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 Sep 05 21:00:44 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:45 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3" returned: 0 in 0.441s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eba66439-74c6-4a25-8637-68898048afdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:00:45 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d3fcf3-ea71-459d-aaad-479ce275a1a2]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:45 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb Sep 05 21:00:45 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:45 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb" returned: 0 in 0.656s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:45 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 Sep 05 21:00:45 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:46 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3" returned: 0 in 0.437s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:46 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3 Sep 05 21:00:46 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:46 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb.12b5bd4c-bb78-4a85-8d79-c633754f46e3" returned: 0 in 0.318s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-12b5bd4c-bb78-4a85-8d79-c633754f46e3" released by "_delete_snapshot" :: held 1.986s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.952s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.795s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1621719548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9426434-5e7c-4cec-966d-e7aec568c008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84775f7c46d84e3b9e445333c5fe0647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:36Z,use_quota=True,user_id='b377eac2f99b4d4c82a8cfc9ac62e1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Creating volume d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:46 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:46 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 1073741824 Sep 05 21:00:46 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3606842c-f7cd-446e-aa8e-7902e4a97832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190a282a-b997-4e70-b099-845520d911fb', 'volume_size': 1, 'source_volid': 'eba66439-74c6-4a25-8637-68898048afdb', 'source_volstatus': 'available'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae24ef3-8a38-46af-b935-ac2951072f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:46 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Volume volume-190a282a-b997-4e70-b099-845520d911fb (190a282a-b997-4e70-b099-845520d911fb): created successfully Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae24ef3-8a38-46af-b935-ac2951072f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:46 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (abaa7c99-d13b-4ad0-a949-5134300b9de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:46 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8949da27-8cb5-42ee-92fb-deb33c59773a tempest-VolumesGetTest-1278876383 None] Created volume successfully. Sep 05 21:00:47 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 1073741824" returned: 0 in 0.462s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:47 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 Sep 05 21:00:47 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:47 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008" returned: 0 in 0.297s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.597s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69a47ec-3e54-49e6-a5c1-5cc40c39b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9426434-5e7c-4cec-966d-e7aec568c008', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3a0c36-785d-4cd6-9289-15c2f4c098e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Creating offline snapshot 5e733874-3ec1-44e5-9f34-d4fb7a659666 of volume 843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:00:47 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Volume volume-d9426434-5e7c-4cec-966d-e7aec568c008 (d9426434-5e7c-4cec-966d-e7aec568c008): created successfully Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3a0c36-785d-4cd6-9289-15c2f4c098e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Flow 'volume_create_manager' (def67340-e485-430f-a66c-77a41d58c5b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf037c-1422-4f67-bb4d-55410e10b330]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0fa4dab7-f3c9-4d57-a65d-b8a3ccb2f31d tempest-VolumeDependencyTests-2034009318 None] Created volume successfully. Sep 05 21:00:47 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 Sep 05 21:00:47 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:48 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1" returned: 0 in 0.499s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:48 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 1G Sep 05 21:00:48 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:48 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 1G" returned: 0 in 0.537s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:48 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 Sep 05 21:00:48 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (1acf8991-699f-4b06-ae4b-5e23b8c0ad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31aabff1-1651-4fdf-a581-63434bd00a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31aabff1-1651-4fdf-a581-63434bd00a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-334533379',display_name='tempest-VolumesGetTest-Volume-1760127193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1071d2c-3a36-4712-81eb-ec586b66b359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:49Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e801b857-e9fe-4c8a-a5e1-d19186a84848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e801b857-e9fe-4c8a-a5e1-d19186a84848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9620558-23a9-450d-a84e-673c49c8955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9620558-23a9-450d-a84e-673c49c8955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1071d2c-3a36-4712-81eb-ec586b66b359', 'volume_name': 'volume-b1071d2c-3a36-4712-81eb-ec586b66b359', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b0ecec-c09e-456c-ab08-fe0ebc3ce323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b0ecec-c09e-456c-ab08-fe0ebc3ce323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f66e40-7357-487c-83c6-929eda525ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Volume b1071d2c-3a36-4712-81eb-ec586b66b359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1071d2c-3a36-4712-81eb-ec586b66b359', 'volume_size': 1} Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:48 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666" returned: 0 in 0.327s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:48 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 is being set with open permissions: ugo+rw Sep 05 21:00:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:48 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 Sep 05 21:00:48 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:49 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666" returned: 0 in 0.287s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:49 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.info Sep 05 21:00:49 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:49 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.info" returned: 0 in 0.290s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:49 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.info is being set with open permissions: ugo+rw Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:49 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.info Sep 05 21:00:49 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:49 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.info" returned: 0 in 0.272s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.714s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Creating offline snapshot a0fc4d26-57aa-4bbf-a2c2-6d436575be2d of volume d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:00:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-673dce2e-37c6-49e2-a9ed-ada904d3b7c2 tempest-VolumesSnapshotListTestJSON-1893540689 None] Create snapshot completed successfully Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d854ece-d151-477a-82ce-1bee66c3ef7c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:50 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 Sep 05 21:00:50 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:50 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008" returned: 0 in 0.534s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:50 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d 1G Sep 05 21:00:50 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:50 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d 1G" returned: 0 in 0.491s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9426434-5e7c-4cec-966d-e7aec568c008 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:51 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9426434-5e7c-4cec-966d-e7aec568c008 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d Sep 05 21:00:51 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:51 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9426434-5e7c-4cec-966d-e7aec568c008 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" returned: 0 in 0.310s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:51 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d is being set with open permissions: ugo+rw Sep 05 21:00:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:51 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d Sep 05 21:00:51 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:51 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" returned: 0 in 0.283s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:51 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.info Sep 05 21:00:51 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:51 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.info" returned: 0 in 0.295s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:51 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.info is being set with open permissions: ugo+rw Sep 05 21:00:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:51 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.info Sep 05 21:00:51 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:52 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.info" returned: 0 in 0.275s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.451s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-334533379',display_name='tempest-VolumesGetTest-Volume-1760127193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1071d2c-3a36-4712-81eb-ec586b66b359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:49Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Creating volume b1071d2c-3a36-4712-81eb-ec586b66b359 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:52 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:52 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 1073741824 Sep 05 21:00:52 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-76128dc2-2cef-4b7d-ba34-cd2b1aa00d50 tempest-VolumeDependencyTests-2034009318 None] Create snapshot completed successfully Sep 05 21:00:52 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 1073741824" returned: 0 in 0.478s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:52 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 Sep 05 21:00:52 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:53 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359" returned: 0 in 0.321s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.270s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f66e40-7357-487c-83c6-929eda525ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1071d2c-3a36-4712-81eb-ec586b66b359', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e16f7b-f20f-4454-91ab-3b26b965fa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Creating offline snapshot f06f0f4d-2b15-44a9-bddf-c4b4860fd4af of volume 843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:00:53 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Volume volume-b1071d2c-3a36-4712-81eb-ec586b66b359 (b1071d2c-3a36-4712-81eb-ec586b66b359): created successfully Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e16f7b-f20f-4454-91ab-3b26b965fa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (1acf8991-699f-4b06-ae4b-5e23b8c0ad98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[155ad67e-e8a7-4621-8935-315aced0a1c1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9af54266-49f7-4a6f-9de6-8799bce509d6 tempest-VolumesGetTest-1278876383 None] Created volume successfully. Sep 05 21:00:53 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 Sep 05 21:00:53 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:53 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666" returned: 0 in 0.487s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843877a1-f94b-4321-9572-83edb44f03f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:00:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:53 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af 1G Sep 05 21:00:53 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Flow 'volume_create_manager' (76ea9058-38fb-4817-9f58-554c28f41685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0145e00c-c418-4dea-ac13-0550c6655c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0145e00c-c418-4dea-ac13-0550c6655c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2115891366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32d3c05-6f85-4437-a605-017ced4d0ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84775f7c46d84e3b9e445333c5fe0647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0fc4d26-57aa-4bbf-a2c2-6d436575be2d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:54Z,use_quota=True,user_id='b377eac2f99b4d4c82a8cfc9ac62e1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fbba0b-68e9-4daa-b27a-137abc971ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fbba0b-68e9-4daa-b27a-137abc971ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8e31fd-959e-4908-a10a-cb2f46ca2128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8e31fd-959e-4908-a10a-cb2f46ca2128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e32d3c05-6f85-4437-a605-017ced4d0ff3', 'volume_name': 'volume-e32d3c05-6f85-4437-a605-017ced4d0ff3', 'volume_size': 1, 'snapshot_id': 'a0fc4d26-57aa-4bbf-a2c2-6d436575be2d'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61dd9f56-95ac-46f8-9e46-02e0a9478079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61dd9f56-95ac-46f8-9e46-02e0a9478079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df72bbbb-f5b8-4357-9540-5aeb15fa1497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Volume e32d3c05-6f85-4437-a605-017ced4d0ff3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e32d3c05-6f85-4437-a605-017ced4d0ff3', 'volume_size': 1, 'snapshot_id': 'a0fc4d26-57aa-4bbf-a2c2-6d436575be2d'} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-b1071d2c-3a36-4712-81eb-ec586b66b359-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Lock "cinder-b1071d2c-3a36-4712-81eb-ec586b66b359-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:54 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af 1G" returned: 0 in 0.636s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:54 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af Sep 05 21:00:54 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-b1071d2c-3a36-4712-81eb-ec586b66b359" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-b1071d2c-3a36-4712-81eb-ec586b66b359" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df2aa28-589e-4e1b-b87e-017497406768]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:54 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 Sep 05 21:00:54 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Flow 'volume_create_manager' (1d1d7d8a-e650-4c8f-b890-2193ea481d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b9ce3e-1e3b-40ae-989b-8149383b3b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b9ce3e-1e3b-40ae-989b-8149383b3b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-784562550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6228032e-d71a-428b-abef-2b8449f64ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79da80ca8cea420ea095ac12f664703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:54Z,use_quota=True,user_id='376da8e2f21e4e049ea3a821f4129c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19322ed4-1147-4d5c-96c1-d51831d8a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19322ed4-1147-4d5c-96c1-d51831d8a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdf277e-c86b-4658-8189-67f8a7e2d472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:00:54 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" returned: 0 in 0.349s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:54 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af is being set with open permissions: ugo+rw Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:54 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af Sep 05 21:00:54 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:54 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359" returned: 0 in 0.421s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:54 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359 Sep 05 21:00:54 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:54 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" returned: 0 in 0.270s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdf277e-c86b-4658-8189-67f8a7e2d472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6228032e-d71a-428b-abef-2b8449f64ee9', 'volume_name': 'volume-6228032e-d71a-428b-abef-2b8449f64ee9', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d03343-246a-4bb6-807b-0c7b6960ac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d03343-246a-4bb6-807b-0c7b6960ac58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc92375-8af4-4f2c-a6ef-e05d9d9d7738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Volume 6228032e-d71a-428b-abef-2b8449f64ee9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6228032e-d71a-428b-abef-2b8449f64ee9', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Trying to clone 6228032e-d71a-428b-abef-2b8449f64ee9 from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.732s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-quobyte-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d-e32d3c05-6f85-4437-a605-017ced4d0ff3" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d-e32d3c05-6f85-4437-a605-017ced4d0ff3" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Creating volume e32d3c05-6f85-4437-a605-017ced4d0ff3 from snapshot a0fc4d26-57aa-4bbf-a2c2-6d436575be2d {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-quobyte-e32d3c05-6f85-4437-a605-017ced4d0ff3" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-abdd6a7b-e96a-4bee-aa1a-174d933c25a0 tempest-VolumesSnapshotListTestJSON-1893540689 None] Create snapshot completed successfully Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-e32d3c05-6f85-4437-a605-017ced4d0ff3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] snapshot: a0fc4d26-57aa-4bbf-a2c2-6d436575be2d, volume: e32d3c05-6f85-4437-a605-017ced4d0ff3, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 21:00:55 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b1071d2c-3a36-4712-81eb-ec586b66b359" returned: 0 in 0.311s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bec25e-2d06-4d4a-9d9f-cf976dbe7f63]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-b1071d2c-3a36-4712-81eb-ec586b66b359" released by "delete_volume" :: held 0.790s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:55 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d Sep 05 21:00:55 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Created reservations ['5dd3ae34-c611-4d36-9f3c-e87ee2b59e94', '15920b14-c904-4b52-a3ea-b34e6cdf44cc', '0d0ef47b-1dc8-487a-9ad0-d30b90ed3bc1', '301199ef-8535-4c6b-a0f5-c321e1e659e8'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:00:55 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Image download 20.69 MB at 20.69 MB/s Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:55 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:55 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d87848-9417-4a30-9c8c-43e0acbe5447]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-190a282a-b997-4e70-b099-845520d911fb-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Lock "cinder-190a282a-b997-4e70-b099-845520d911fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-190a282a-b997-4e70-b099-845520d911fb" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-190a282a-b997-4e70-b099-845520d911fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:55 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD Sep 05 21:00:55 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5299d-b38a-471d-a105-02c4951d1c70]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:55 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:55 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:55 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" returned: 0 in 0.573s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9426434-5e7c-4cec-966d-e7aec568c008(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2014ec8-c363-4ffd-a469-baf848490a5a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:55 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 Sep 05 21:00:55 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:55 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.423s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Deleted volume successfully. Sep 05 21:00:55 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb Sep 05 21:00:55 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e78e7af4-a15e-4582-ada3-472503dec8b7 tempest-VolumesGetTest-1278876383 None] Lock "cinder-b1071d2c-3a36-4712-81eb-ec586b66b359-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:55 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:55 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.280s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df is fetched for user 376da8e2f21e4e049ea3a821f4129c9e. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:00:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[591424e6-2b24-4991-b2e5-99f766f8cb5e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:56 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD Sep 05 21:00:56 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:56 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008" returned: 0 in 0.471s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:56 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 Sep 05 21:00:56 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:56 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb" returned: 0 in 0.606s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:56 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb Sep 05 21:00:56 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:56 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:56 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-190a282a-b997-4e70-b099-845520d911fb" returned: 0 in 0.255s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-190a282a-b997-4e70-b099-845520d911fb" released by "delete_volume" :: held 0.921s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Created reservations ['16e06285-4da8-40a3-8e80-fbd010e9794b', '5c1ea587-d1a6-4975-9fa1-e555e534e371', '6e50b875-bb95-45ea-a01b-cbd171054e43', 'c4c1cb18-ea46-40b9-b26c-b53cee7cc89f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:56 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:56 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-eba66439-74c6-4a25-8637-68898048afdb-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Lock "cinder-eba66439-74c6-4a25-8637-68898048afdb-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-eba66439-74c6-4a25-8637-68898048afdb" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-eba66439-74c6-4a25-8637-68898048afdb" acquired by "delete_volume" :: waited 0.054s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:57 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.691s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Deleted volume successfully. Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6868d0a9-e150-4ed3-8048-b3d7fdbdaf75]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-24964db2-73ad-4c65-9ea9-eb8bb9a5febf tempest-VolumesGetTest-1278876383 None] Lock "cinder-190a282a-b997-4e70-b099-845520d911fb-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:57 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb Sep 05 21:00:57 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:58 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb" returned: 0 in 0.923s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:58 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb Sep 05 21:00:58 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:58 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-eba66439-74c6-4a25-8637-68898048afdb" returned: 0 in 0.580s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-eba66439-74c6-4a25-8637-68898048afdb" released by "delete_volume" :: held 1.651s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Created reservations ['db2745e1-952d-4b8d-a663-1534973ba287', '418f3bad-2223-4332-a4a4-f1a76a7483ac', '680a5836-889b-465d-b50e-16f2b250c447', 'deec49fa-aa73-4224-993f-92c32792d062'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:59 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:00:59 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:59 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.554s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:59 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Deleted volume successfully. Sep 05 21:01:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bc938620-1129-4149-a2ab-5d9db8b503bb tempest-VolumesGetTest-1278876383 None] Lock "cinder-eba66439-74c6-4a25-8637-68898048afdb-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:01 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3" returned: 0 in 4.950s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:01:01 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Converted 1024.00 MB image at 206.84 MB/s Sep 05 21:01:01 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 is being set with open permissions: ugo+rw Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:01 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 Sep 05 21:01:01 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (6cc31eb1-b8ac-481e-9a57-3daa894af41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88780fa0-d5f0-4701-9638-5c1fc2076175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88780fa0-d5f0-4701-9638-5c1fc2076175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-309546589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b413710-fa4c-47cc-a7ff-b5c9645196db,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:01Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e647fbb9-8faf-435b-a3da-641b23615d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e647fbb9-8faf-435b-a3da-641b23615d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82a8b9f-9fe4-4c5f-80a9-fd9ca19dceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:01 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3" returned: 0 in 0.256s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-e32d3c05-6f85-4437-a605-017ced4d0ff3" released by "_copy_volume_from_snapshot" :: held 6.355s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d-e32d3c05-6f85-4437-a605-017ced4d0ff3" released by "_create_volume_from_snapshot" :: held 6.429s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.473s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.173s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Creating offline snapshot ba2281c1-2baa-4465-90ac-047a4bb3b398 of volume 843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df72bbbb-f5b8-4357-9540-5aeb15fa1497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32d3c05-6f85-4437-a605-017ced4d0ff3', 'volume_size': 1, 'snapshot_id': 'a0fc4d26-57aa-4bbf-a2c2-6d436575be2d'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2843bb-8def-430e-8ac6-e518074a983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[303c89ae-77e1-4be4-b95e-de0210f4382d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:01 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Volume volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 (e32d3c05-6f85-4437-a605-017ced4d0ff3): created successfully Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2843bb-8def-430e-8ac6-e518074a983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Flow 'volume_create_manager' (76ea9058-38fb-4817-9f58-554c28f41685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:01 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c1e508b4-69e9-4c77-9695-032511d4a5b5 tempest-VolumeDependencyTests-2034009318 None] Created volume successfully. Sep 05 21:01:01 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af Sep 05 21:01:01 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82a8b9f-9fe4-4c5f-80a9-fd9ca19dceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b413710-fa4c-47cc-a7ff-b5c9645196db', 'volume_name': 'volume-2b413710-fa4c-47cc-a7ff-b5c9645196db', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802eb958-14ce-4656-9565-46e73a6b12f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802eb958-14ce-4656-9565-46e73a6b12f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022141f8-a95b-4739-88d4-f6dbe1cdf08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:01 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Volume 2b413710-fa4c-47cc-a7ff-b5c9645196db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b413710-fa4c-47cc-a7ff-b5c9645196db', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Trying to clone 2b413710-fa4c-47cc-a7ff-b5c9645196db from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-quobyte-d9426434-5e7c-4cec-966d-e7aec568c008" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:01 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-d9426434-5e7c-4cec-966d-e7aec568c008" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-quobyte-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" returned: 0 in 0.445s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843877a1-f94b-4321-9572-83edb44f03f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:01:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:02 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 1G Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:02 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Deleting offline snapshot a0fc4d26-57aa-4bbf-a2c2-6d436575be2d of volume d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] snapshot_file for this snap is: volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a01dfd8-5078-4053-aeca-63f6b1b1ec1e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:01:02 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Image download 20.69 MB at 20.69 MB/s Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66ab600-a76c-4aec-9203-caeb34b4412d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:02 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d Sep 05 21:01:02 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:02 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD Sep 05 21:01:02 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:02 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9426434-5e7c-4cec-966d-e7aec568c008(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[892dc3aa-5f15-4662-a9c9-604e1ac650cf]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:02 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 1G" returned: 0 in 0.501s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:02 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df is fetched for user 2c13cd672b9d4040a457bc53f93e234c. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:01:02 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 Sep 05 21:01:02 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe82dce-5009-4447-ac7c-2bbe349d7294]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:02 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 Sep 05 21:01:02 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:02 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD Sep 05 21:01:02 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:02 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398" returned: 0 in 0.295s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:02 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 is being set with open permissions: ugo+rw Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:02 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 Sep 05 21:01:02 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:02 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:03 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008" returned: 0 in 0.548s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:03 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398" returned: 0 in 0.249s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d Sep 05 21:01:03 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.603s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.599s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-784562550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6228032e-d71a-428b-abef-2b8449f64ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79da80ca8cea420ea095ac12f664703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:54Z,use_quota=True,user_id='376da8e2f21e4e049ea3a821f4129c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Creating volume 6228032e-d71a-428b-abef-2b8449f64ee9 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:01:03 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:03 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 1073741824 Sep 05 21:01:03 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b52b43cc-9942-4a51-8f27-ca9d969b2549 tempest-VolumesSnapshotListTestJSON-1893540689 None] Create snapshot completed successfully Sep 05 21:01:03 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" returned: 0 in 0.413s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:03 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d Sep 05 21:01:03 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:03 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 1073741824" returned: 0 in 0.476s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:03 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 Sep 05 21:01:03 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:03 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008.a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" returned: 0 in 0.265s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d" released by "_delete_snapshot" :: held 1.732s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-d9426434-5e7c-4cec-966d-e7aec568c008" released by "delete_snapshot" :: held 1.780s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Created reservations ['51afee1b-8242-4cc9-902e-6330ec0d072e', '332ea3a8-e3ad-4942-9879-ff59d9eb7d00', 'd5d82c70-074b-43fa-b42f-79d2f818e15f', '548793d4-648c-40ee-9b28-544b66f9aac8'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:03 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9" returned: 0 in 0.271s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-309546589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b413710-fa4c-47cc-a7ff-b5c9645196db,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:01Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Creating volume 2b413710-fa4c-47cc-a7ff-b5c9645196db {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:01:03 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:03 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db 1073741824 Sep 05 21:01:03 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Attempting download of 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume 6228032e-d71a-428b-abef-2b8449f64ee9. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:01:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Delete snapshot completed successfully. Sep 05 21:01:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f1dab0ec-2120-45fb-936f-d38c80fbbb4a tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-a0fc4d26-57aa-4bbf-a2c2-6d436575be2d-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[89554bd2-23d0-4411-82ab-859f73bb51db]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_vqtxptb9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-d9426434-5e7c-4cec-966d-e7aec568c008-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-d9426434-5e7c-4cec-966d-e7aec568c008-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-quobyte-d9426434-5e7c-4cec-966d-e7aec568c008" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-d9426434-5e7c-4cec-966d-e7aec568c008" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:04 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_vqtxptb9 Sep 05 21:01:04 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf043b5-9eec-404e-a3d6-f26b2cb6ff23]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:04 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 Sep 05 21:01:04 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:04 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db 1073741824" returned: 0 in 0.650s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:04 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_vqtxptb9" returned: 0 in 0.541s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_vqtxptb9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:04 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db Sep 05 21:01:04 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:04 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_vqtxptb9 Sep 05 21:01:04 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:04 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008" returned: 0 in 0.529s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:04 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008 Sep 05 21:01:04 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:04 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db" returned: 0 in 0.324s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:04 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Attempting download of 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume 2b413710-fa4c-47cc-a7ff-b5c9645196db. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:01:05 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_vqtxptb9" returned: 1 in 0.455s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_vqtxptb9' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef771125-e8a2-43c1-bf9d-3f4574c38627]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8039110a-538b-4cd1-99c4-905183ff5ab2]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_buqf_3l8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:05 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d9426434-5e7c-4cec-966d-e7aec568c008" returned: 0 in 0.329s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:05 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD Sep 05 21:01:05 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-d9426434-5e7c-4cec-966d-e7aec568c008" released by "delete_volume" :: held 0.968s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:05 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_buqf_3l8 Sep 05 21:01:05 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-ba2281c1-2baa-4465-90ac-047a4bb3b398-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Created reservations ['9e310c14-451b-49e0-9dc7-1746e2b651bb', '2d5c3d6c-349f-486c-8014-ff8b8bda8a22', '87a38f58-d66c-4f39-b2ba-51257e004190', 'bb691ae9-db89-4098-8158-3ee9b74d9fac'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-ba2281c1-2baa-4465-90ac-047a4bb3b398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-quobyte-ba2281c1-2baa-4465-90ac-047a4bb3b398" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-ba2281c1-2baa-4465-90ac-047a4bb3b398" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Deleting offline snapshot ba2281c1-2baa-4465-90ac-047a4bb3b398 of volume 843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] snapshot_file for this snap is: volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[594b5bf8-67eb-4751-874a-ba8378c19ad3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:05 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df was qcow2, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:05 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:01:05 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:05 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_buqf_3l8" returned: 0 in 0.479s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_buqf_3l8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:05 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 Sep 05 21:01:05 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:05 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 Sep 05 21:01:05 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:05 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_buqf_3l8 Sep 05 21:01:05 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:05 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.281s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Deleted volume successfully. Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2a23fb3e-8b45-420a-a110-b730f0bc03b9 tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-d9426434-5e7c-4cec-966d-e7aec568c008-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:05 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398" returned: 0 in 0.486s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843877a1-f94b-4321-9572-83edb44f03f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:01:05 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_buqf_3l8" returned: 1 in 0.408s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_buqf_3l8' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ddee6a-4669-44ea-9cbe-543766f8285c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cf8232-d859-484f-9c23-eac06fa499bd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:06 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD Sep 05 21:01:06 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:06 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af Sep 05 21:01:06 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:06 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df was qcow2, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:06 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db Sep 05 21:01:06 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-e32d3c05-6f85-4437-a605-017ced4d0ff3-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:06 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" returned: 0 in 0.492s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843877a1-f94b-4321-9572-83edb44f03f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-e32d3c05-6f85-4437-a605-017ced4d0ff3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:06 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 Sep 05 21:01:06 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "cinder-quobyte-e32d3c05-6f85-4437-a605-017ced4d0ff3" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-e32d3c05-6f85-4437-a605-017ced4d0ff3" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d91857-677d-40a8-936c-cbd2673a2652]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:06 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 Sep 05 21:01:06 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:07 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3" returned: 0 in 0.463s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:07 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3 Sep 05 21:01:07 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:07 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398" returned: 0 in 0.695s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:07 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398 Sep 05 21:01:07 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:07 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.ba2281c1-2baa-4465-90ac-047a4bb3b398" returned: 0 in 0.345s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:07 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e32d3c05-6f85-4437-a605-017ced4d0ff3" returned: 0 in 0.440s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-ba2281c1-2baa-4465-90ac-047a4bb3b398" released by "_delete_snapshot" :: held 2.177s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-quobyte-e32d3c05-6f85-4437-a605-017ced4d0ff3" released by "delete_volume" :: held 0.980s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" released by "delete_snapshot" :: held 2.220s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Created reservations ['217e6fe7-a4fe-4736-a1b9-38af4e788b28', 'df613653-041f-4546-86c9-1b5c0c765520', 'dd9d2747-d03c-4f96-821e-c2e10853e66e', '0ac5f0d7-49d3-4fe0-828d-2a9d6c8acb7f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Created reservations ['c7fb264d-190b-4196-a0f5-048d1cbcda3f', '1814a749-12da-477f-9036-0e8886a31a02', 'bc33d190-30ad-423d-ae38-c23f4eb1c513', 'f2617b5e-114f-471d-9807-576516fcf386'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:07 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9" returned: 0 in 2.336s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_xz8clpi5devstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:01:07 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Converted 112.00 MB image at 47.84 MB/s Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:07 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:01:07 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:07 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Delete snapshot completed successfully. Sep 05 21:01:07 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 1G Sep 05 21:01:07 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-eb7b49be-7aed-419b-a74a-372459b758a9 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-ba2281c1-2baa-4465-90ac-047a4bb3b398-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:08 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.298s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:08 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Deleted volume successfully. Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-167b5f5f-7ae0-47f1-bc0d-538f32b413bd tempest-VolumeDependencyTests-2034009318 None] Lock "cinder-e32d3c05-6f85-4437-a605-017ced4d0ff3-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:08 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 1G" returned: 0 in 0.412s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Downloaded image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume 6228032e-d71a-428b-abef-2b8449f64ee9 successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df for user 376da8e2f21e4e049ea3a821f4129c9e is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Marking volume 6228032e-d71a-428b-abef-2b8449f64ee9 as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Copying metadata from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df to 6228032e-d71a-428b-abef-2b8449f64ee9. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Creating volume glance metadata for volume 6228032e-d71a-428b-abef-2b8449f64ee9 backed by image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc92375-8af4-4f2c-a6ef-e05d9d9d7738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6228032e-d71a-428b-abef-2b8449f64ee9', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b441c9-82a8-4a12-a5e1-861f5830ff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:08 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Volume volume-6228032e-d71a-428b-abef-2b8449f64ee9 (6228032e-d71a-428b-abef-2b8449f64ee9): created successfully Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b441c9-82a8-4a12-a5e1-861f5830ff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Flow 'volume_create_manager' (1d1d7d8a-e650-4c8f-b890-2193ea481d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:08 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e19f7f86-6eab-444b-98ee-e2ccf893e3b4 tempest-TestShelveInstance-456236150 None] Created volume successfully. Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-f06f0f4d-2b15-44a9-bddf-c4b4860fd4af-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-f06f0f4d-2b15-44a9-bddf-c4b4860fd4af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:08 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db" returned: 0 in 2.235s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d84e6ed-7ef2-4e37-a91d-20dfb060d3df_k0udb8wydevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:01:08 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Converted 112.00 MB image at 50.10 MB/s Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-quobyte-f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:08 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db 1G Sep 05 21:01:08 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Deleting offline snapshot f06f0f4d-2b15-44a9-bddf-c4b4860fd4af of volume 843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] snapshot_file for this snap is: volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f5b55-01d2-4c34-a364-c9b7718a2a61]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:08 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af Sep 05 21:01:08 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:08 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db 1G" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Downloaded image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df ((None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}])) to volume 2b413710-fa4c-47cc-a7ff-b5c9645196db successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Temporary image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df for user 2c13cd672b9d4040a457bc53f93e234c is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Marking volume 2b413710-fa4c-47cc-a7ff-b5c9645196db as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Copying metadata from image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df to 2b413710-fa4c-47cc-a7ff-b5c9645196db. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:01:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Creating volume glance metadata for volume 2b413710-fa4c-47cc-a7ff-b5c9645196db backed by image 2d84e6ed-7ef2-4e37-a91d-20dfb060d3df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022141f8-a95b-4739-88d4-f6dbe1cdf08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b413710-fa4c-47cc-a7ff-b5c9645196db', 'volume_size': 1, 'image_id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed802d3022c44fb780fefef8137c6436', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d84e6ed-7ef2-4e37-a91d-20dfb060d3df', 'created_at': datetime.datetime(2026, 9, 5, 18, 41, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84e6ed-7ef2-4e37-a91d-20dfb060d3df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99366382-b001-40f0-9bd2-37f725cda8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:09 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Volume volume-2b413710-fa4c-47cc-a7ff-b5c9645196db (2b413710-fa4c-47cc-a7ff-b5c9645196db): created successfully Sep 05 21:01:09 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99366382-b001-40f0-9bd2-37f725cda8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (6cc31eb1-b8ac-481e-9a57-3daa894af41d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" returned: 0 in 0.523s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843877a1-f94b-4321-9572-83edb44f03f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:01:09 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-75b35a3d-90bb-455a-8eba-5fe8f694f6ba tempest-VolumesGetTest-1278876383 None] Created volume successfully. Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[602a79c6-4bde-4e3d-9c3e-4b4b4bf1ed25]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:09 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 Sep 05 21:01:09 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:09 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666" returned: 0 in 0.431s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843877a1-f94b-4321-9572-83edb44f03f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:01:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:09 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af Sep 05 21:01:09 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:10 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" returned: 0 in 0.593s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:10 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af Sep 05 21:01:10 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:10 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" returned: 0 in 0.383s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-f06f0f4d-2b15-44a9-bddf-c4b4860fd4af" released by "_delete_snapshot" :: held 2.081s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" released by "delete_snapshot" :: held 2.110s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:10 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Created reservations ['e4ae22f4-ff60-4493-a619-72c92c51adcf', '26ee1274-9b6e-4e98-b328-fa04412dddf2', 'f419cf1a-d292-4812-9cac-ec6aacf1a565', '1c0865a1-7bd1-483a-8fbd-92af67352a76'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:10 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Delete snapshot completed successfully. Sep 05 21:01:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-22bf56bd-1ecb-45a9-92d3-c3d0157761ec tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-f06f0f4d-2b15-44a9-bddf-c4b4860fd4af-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (bd73c025-0d2f-4b56-abe3-510b37659868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6385a2c-f2ca-45c3-a2d7-3bc627a1a792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6385a2c-f2ca-45c3-a2d7-3bc627a1a792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-767513753',display_name='tempest-VolumesGetTest-Volume-675036707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5fc992-3428-4201-94f4-167ee1ccee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:11Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064ed5d4-e45a-4676-b145-654bd344b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064ed5d4-e45a-4676-b145-654bd344b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a021eccc-3200-48c0-b27f-51ece6e10698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a021eccc-3200-48c0-b27f-51ece6e10698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5fc992-3428-4201-94f4-167ee1ccee03', 'volume_name': 'volume-cf5fc992-3428-4201-94f4-167ee1ccee03', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27124bf5-5bb5-4efc-9e39-57ecde62e5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27124bf5-5bb5-4efc-9e39-57ecde62e5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7125e99-89f5-4e3c-aa93-854516a028db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:11 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Volume cf5fc992-3428-4201-94f4-167ee1ccee03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5fc992-3428-4201-94f4-167ee1ccee03', 'volume_size': 1} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-767513753',display_name='tempest-VolumesGetTest-Volume-675036707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5fc992-3428-4201-94f4-167ee1ccee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950846182e44e84a196380611463bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:11Z,use_quota=True,user_id='2c13cd672b9d4040a457bc53f93e234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Creating volume cf5fc992-3428-4201-94f4-167ee1ccee03 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:01:11 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:11 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 1073741824 Sep 05 21:01:11 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-5e733874-3ec1-44e5-9f34-d4fb7a659666-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-5e733874-3ec1-44e5-9f34-d4fb7a659666-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-quobyte-5e733874-3ec1-44e5-9f34-d4fb7a659666" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-5e733874-3ec1-44e5-9f34-d4fb7a659666" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Deleting offline snapshot 5e733874-3ec1-44e5-9f34-d4fb7a659666 of volume 843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:01:11 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] snapshot_file for this snap is: volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 1073741824" returned: 0 in 0.655s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[168e86d3-9c64-4cf8-b6b6-7f4d65865164]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:12 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 Sep 05 21:01:12 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-43af64ea-2d31-497a-9d48-cc863b0a456a req-5eaace59-f4f5-4e78-85d7-96b55f9e15e4 tempest-TestShelveInstance-456236150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:12 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 Sep 05 21:01:12 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:12 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03" returned: 0 in 0.367s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-43af64ea-2d31-497a-9d48-cc863b0a456a req-5eaace59-f4f5-4e78-85d7-96b55f9e15e4 tempest-TestShelveInstance-456236150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.238s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7125e99-89f5-4e3c-aa93-854516a028db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5fc992-3428-4201-94f4-167ee1ccee03', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb18d17-0f5c-4bb9-a06a-9ee12608b98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-43af64ea-2d31-497a-9d48-cc863b0a456a req-5eaace59-f4f5-4e78-85d7-96b55f9e15e4 tempest-TestShelveInstance-456236150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:12 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Volume volume-cf5fc992-3428-4201-94f4-167ee1ccee03 (cf5fc992-3428-4201-94f4-167ee1ccee03): created successfully Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb18d17-0f5c-4bb9-a06a-9ee12608b98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Flow 'volume_create_manager' (bd73c025-0d2f-4b56-abe3-510b37659868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:12 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666" returned: 0 in 0.546s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843877a1-f94b-4321-9572-83edb44f03f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:01:12 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-17886722-224b-4492-9a47-91948b12fe7d tempest-VolumesGetTest-1278876383 None] Created volume successfully. Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f43c96-a7a1-4e08-82a4-b836762c4b3b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-43af64ea-2d31-497a-9d48-cc863b0a456a req-5eaace59-f4f5-4e78-85d7-96b55f9e15e4 tempest-TestShelveInstance-456236150 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-6228032e-d71a-428b-abef-2b8449f64ee9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '349aa600-8497-4fdc-84ea-ddaab755949e', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:01:12 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-43af64ea-2d31-497a-9d48-cc863b0a456a req-5eaace59-f4f5-4e78-85d7-96b55f9e15e4 tempest-TestShelveInstance-456236150 None] attachment_update completed successfully. Sep 05 21:01:12 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 Sep 05 21:01:12 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:13 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1" returned: 0 in 0.668s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:13 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 Sep 05 21:01:13 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-cf5fc992-3428-4201-94f4-167ee1ccee03-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Lock "cinder-cf5fc992-3428-4201-94f4-167ee1ccee03-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-cf5fc992-3428-4201-94f4-167ee1ccee03" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-cf5fc992-3428-4201-94f4-167ee1ccee03" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af8173d-9d50-46d0-92a4-b6def44e2944]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:13 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666" returned: 0 in 0.492s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:13 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666 Sep 05 21:01:13 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:13 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 Sep 05 21:01:13 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:14 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1.5e733874-3ec1-44e5-9f34-d4fb7a659666" returned: 0 in 0.409s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-5e733874-3ec1-44e5-9f34-d4fb7a659666" released by "_delete_snapshot" :: held 2.288s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" released by "delete_snapshot" :: held 2.327s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:14 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03" returned: 0 in 0.527s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:14 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03 Sep 05 21:01:14 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Created reservations ['afaf4bb7-2ca8-4466-acb8-473af9055c99', '61fe6511-61e0-44a1-9004-bdd3fbc794fa', '7196c3be-d210-4600-8e9a-c2783fa50cce', 'c438ce8a-2c23-465c-945f-55b12bc5196d'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:14 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Delete snapshot completed successfully. Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3e3f78a7-0438-41c7-9b58-79fc0a19f13d tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-5e733874-3ec1-44e5-9f34-d4fb7a659666-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:14 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-cf5fc992-3428-4201-94f4-167ee1ccee03" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-cf5fc992-3428-4201-94f4-167ee1ccee03" released by "delete_volume" :: held 0.976s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Created reservations ['0265dab6-3b13-47d5-934e-1e5c2db8663a', '57c8c811-03ba-4d25-9a7c-f8d7d6ebb5da', 'f1e1d617-0658-4a10-8411-998cd7f7884d', '1b623be7-3528-4d2f-8325-c49c55e34acd'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:14 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:01:14 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:15 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.315s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:15 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Deleted volume successfully. Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3fd18b4-8fd3-4065-bce3-367d8857b472 tempest-VolumesGetTest-1278876383 None] Lock "cinder-cf5fc992-3428-4201-94f4-167ee1ccee03-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-843877a1-f94b-4321-9572-83edb44f03f1-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-843877a1-f94b-4321-9572-83edb44f03f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b0a651-9794-45b6-920e-1374abe7ad2e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:15 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 Sep 05 21:01:15 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-2b413710-fa4c-47cc-a7ff-b5c9645196db-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Lock "cinder-2b413710-fa4c-47cc-a7ff-b5c9645196db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Acquiring lock "cinder-quobyte-2b413710-fa4c-47cc-a7ff-b5c9645196db" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-2b413710-fa4c-47cc-a7ff-b5c9645196db" acquired by "delete_volume" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:16 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1" returned: 0 in 0.913s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[45997c2e-3860-433a-b950-21b6bddd8592]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:16 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1 Sep 05 21:01:16 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:16 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db Sep 05 21:01:16 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:16 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-843877a1-f94b-4321-9572-83edb44f03f1" returned: 0 in 0.430s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-quobyte-843877a1-f94b-4321-9572-83edb44f03f1" released by "delete_volume" :: held 1.475s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:16 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Created reservations ['15ea0a57-9634-4e41-a155-22aff3801e91', '5ca3989d-256c-4357-aaee-6614b5c76278', 'd1f1c39d-726b-4c9a-bf71-0f652cb2dd07', 'dca69927-03e7-4435-8c04-48e1baea2b4a'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:17 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db" returned: 0 in 0.720s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:17 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:01:17 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:17 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db Sep 05 21:01:17 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:17 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:17 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Deleted volume successfully. Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52971689-ed0e-4434-9d46-3aae261acc80 tempest-VolumesSnapshotListTestJSON-1893540689 None] Lock "cinder-843877a1-f94b-4321-9572-83edb44f03f1-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:17 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2b413710-fa4c-47cc-a7ff-b5c9645196db" returned: 0 in 0.478s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Lock "cinder-quobyte-2b413710-fa4c-47cc-a7ff-b5c9645196db" released by "delete_volume" :: held 1.327s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Created reservations ['ce8cb885-e41d-40bf-b4fb-52102b380e38', '87e38956-fc15-46ea-bfe1-23ccdf45ec8d', '60615467-59a9-4a6b-8ef5-1da8334f3b77', 'a734f53d-18a0-4c66-ae1e-4ab1b9f81591'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Flow 'volume_create_manager' (869e230d-2d64-434a-841d-368f4a253126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040fcb61-363b-41c9-a76a-a117370520f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040fcb61-363b-41c9-a76a-a117370520f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a1eecc-e4fd-476a-b723-d23693edfcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd99f2a2ef4c74aaedeec7d31b4685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:18Z,use_quota=True,user_id='2681f90a01774266a755ebc638623f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295219fc-acbb-4c7c-a412-54502eac008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295219fc-acbb-4c7c-a412-54502eac008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8360fa-d333-4a15-896a-19543dc3c439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:18 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:01:18 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:18 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:18 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Deleted volume successfully. Sep 05 21:01:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-843808dd-7ae1-4aa3-9a96-f71d240f18cf tempest-VolumesGetTest-1278876383 None] Lock "cinder-2b413710-fa4c-47cc-a7ff-b5c9645196db-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8360fa-d333-4a15-896a-19543dc3c439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22a1eecc-e4fd-476a-b723-d23693edfcf2', 'volume_name': 'volume-22a1eecc-e4fd-476a-b723-d23693edfcf2', 'volume_size': 1, 'image_id': '4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '218d133310a6a175071bb332e84c71c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '36dd99f2a2ef4c74aaedeec7d31b4685', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '675368f08b44b6f9ab8f8c94aedd1803c1bd2b9f542e91935d9ed2bf129a87d83c2cebd71866098f5d270ed8fd8389dceedb3ee52ca1c715201ce78e507678c2', 'id': '4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'created_at': datetime.datetime(2026, 9, 5, 19, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448/file', 'properties': {}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94978548-f6ad-4634-a4a5-a1af73a85505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94978548-f6ad-4634-a4a5-a1af73a85505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb607d2-49b0-4884-9e49-d43f7c225e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:19 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Volume 22a1eecc-e4fd-476a-b723-d23693edfcf2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22a1eecc-e4fd-476a-b723-d23693edfcf2', 'volume_size': 1, 'image_id': '4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '218d133310a6a175071bb332e84c71c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '36dd99f2a2ef4c74aaedeec7d31b4685', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '675368f08b44b6f9ab8f8c94aedd1803c1bd2b9f542e91935d9ed2bf129a87d83c2cebd71866098f5d270ed8fd8389dceedb3ee52ca1c715201ce78e507678c2', 'id': '4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'created_at': datetime.datetime(2026, 9, 5, 19, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448/file', 'properties': {}}, 'image_service': } Sep 05 21:01:19 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Trying to clone 22a1eecc-e4fd-476a-b723-d23693edfcf2 from image 4c069136-56e6-4b08-8cb7-d02ac8ceb448 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:01:19 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:01:19 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Image download 0.00 MB at 0.00 MB/s Sep 05 21:01:19 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b098c7-9eb7-4bbf-bc05-f1788d909245]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:19 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD Sep 05 21:01:19 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:20 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD" returned: 0 in 0.673s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:20 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD Sep 05 21:01:20 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:20 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD" returned: 1 in 0.753s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:01:20 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Temporary image 4c069136-56e6-4b08-8cb7-d02ac8ceb448 is fetched for user 2681f90a01774266a755ebc638623f78. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:01:20 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=161,cinder:UPDATE=182,cinder:INSERT=54,cinder:DELETE=12 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:01:21 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10453e3-3469-498c-9b68-4c0f92278bd1]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:21 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD Sep 05 21:01:21 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:21 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD" returned: 0 in 0.670s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:21 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD Sep 05 21:01:21 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:22 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD" returned: 1 in 0.644s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a1eecc-e4fd-476a-b723-d23693edfcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd99f2a2ef4c74aaedeec7d31b4685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:18Z,use_quota=True,user_id='2681f90a01774266a755ebc638623f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Creating volume 22a1eecc-e4fd-476a-b723-d23693edfcf2 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:01:22 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:01:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:22 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 1073741824 Sep 05 21:01:22 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:23 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 1073741824" returned: 0 in 0.931s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:23 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=175,cinder:DELETE=17,cinder:SELECT=143,cinder:INSERT=59 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:01:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:23 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 Sep 05 21:01:23 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:23 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2" returned: 0 in 0.515s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:23 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Attempting download of 4c069136-56e6-4b08-8cb7-d02ac8ceb448 ((None, [{'url': 'file:///opt/stack/data/glance/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'metadata': {}}])) to volume 22a1eecc-e4fd-476a-b723-d23693edfcf2. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:01:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b432963-b4ad-4889-b13b-ae7e35fae0b9]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c069136-56e6-4b08-8cb7-d02ac8ceb448_worjyy4n {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:24 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c069136-56e6-4b08-8cb7-d02ac8ceb448_worjyy4n Sep 05 21:01:24 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:24 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c069136-56e6-4b08-8cb7-d02ac8ceb448_worjyy4n" returned: 0 in 0.593s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c069136-56e6-4b08-8cb7-d02ac8ceb448_worjyy4n {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:24 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c069136-56e6-4b08-8cb7-d02ac8ceb448_worjyy4n Sep 05 21:01:24 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:25 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c069136-56e6-4b08-8cb7-d02ac8ceb448_worjyy4n" returned: 1 in 0.592s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c069136-56e6-4b08-8cb7-d02ac8ceb448_worjyy4n' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:01:25 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f033aaf5-b774-45e2-a967-ea855208cdca]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:25 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD Sep 05 21:01:25 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:26 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:26 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD Sep 05 21:01:26 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:26 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:01:26 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] 4c069136-56e6-4b08-8cb7-d02ac8ceb448 was raw, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:01:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:26 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 Sep 05 21:01:26 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:27 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2" returned: 0 in 0.792s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c069136-56e6-4b08-8cb7-d02ac8ceb448_z81f1hufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:01:27 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:27 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 1G Sep 05 21:01:27 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:27 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 1G" returned: 0 in 0.471s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Downloaded image 4c069136-56e6-4b08-8cb7-d02ac8ceb448 ((None, [{'url': 'file:///opt/stack/data/glance/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'metadata': {}}])) to volume 22a1eecc-e4fd-476a-b723-d23693edfcf2 successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Temporary image 4c069136-56e6-4b08-8cb7-d02ac8ceb448 for user 2681f90a01774266a755ebc638623f78 is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Marking volume 22a1eecc-e4fd-476a-b723-d23693edfcf2 as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Copying metadata from image 4c069136-56e6-4b08-8cb7-d02ac8ceb448 to 22a1eecc-e4fd-476a-b723-d23693edfcf2. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Creating volume glance metadata for volume 22a1eecc-e4fd-476a-b723-d23693edfcf2 backed by image 4c069136-56e6-4b08-8cb7-d02ac8ceb448 with: {'image_id': '4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '218d133310a6a175071bb332e84c71c8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb607d2-49b0-4884-9e49-d43f7c225e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a1eecc-e4fd-476a-b723-d23693edfcf2', 'volume_size': 1, 'image_id': '4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '218d133310a6a175071bb332e84c71c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '36dd99f2a2ef4c74aaedeec7d31b4685', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '675368f08b44b6f9ab8f8c94aedd1803c1bd2b9f542e91935d9ed2bf129a87d83c2cebd71866098f5d270ed8fd8389dceedb3ee52ca1c715201ce78e507678c2', 'id': '4c069136-56e6-4b08-8cb7-d02ac8ceb448', 'created_at': datetime.datetime(2026, 9, 5, 19, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c069136-56e6-4b08-8cb7-d02ac8ceb448/file', 'properties': {}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f198e8-f1ac-4c78-bdf9-0d35314199c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:27 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Volume volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 (22a1eecc-e4fd-476a-b723-d23693edfcf2): created successfully Sep 05 21:01:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f198e8-f1ac-4c78-bdf9-0d35314199c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Flow 'volume_create_manager' (869e230d-2d64-434a-841d-368f4a253126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8ab0d37b-ff89-4fbe-92bb-3fcd507824e3 tempest-VolumeImageDependencyTests-1898300567 None] Created volume successfully. Sep 05 21:01:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Acquiring lock "cinder-22a1eecc-e4fd-476a-b723-d23693edfcf2-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Lock "cinder-22a1eecc-e4fd-476a-b723-d23693edfcf2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Acquiring lock "cinder-quobyte-22a1eecc-e4fd-476a-b723-d23693edfcf2" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Lock "cinder-quobyte-22a1eecc-e4fd-476a-b723-d23693edfcf2" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:29 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0197e9-d359-4d2f-8c7d-4aabb84d04e3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:29 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 Sep 05 21:01:29 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:29 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2" returned: 0 in 0.475s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:29 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2 Sep 05 21:01:29 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:29 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-22a1eecc-e4fd-476a-b723-d23693edfcf2" returned: 0 in 0.370s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Lock "cinder-quobyte-22a1eecc-e4fd-476a-b723-d23693edfcf2" released by "delete_volume" :: held 0.913s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Created reservations ['dea005cd-8a21-497e-a31c-d18be3fe590d', 'e5dd27f6-5032-4cd1-a63a-222ded645bdc', '247ca55b-a39f-462f-a704-f678f4cf80f2', '010f84f2-8cdf-43bb-83b0-6445e9a6279f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:30 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:01:30 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:30 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.393s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Deleted volume successfully. Sep 05 21:01:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a63b5d20-2176-4c33-ba59-271fe9b59e7c tempest-VolumeImageDependencyTests-1898300567 None] Lock "cinder-22a1eecc-e4fd-476a-b723-d23693edfcf2-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:40 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=9,cinder:SELECT=11,cinder:INSERT=7 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:01:40 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=15,cinder:SELECT=9,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Flow 'volume_create_manager' (28e267be-37e8-4fdc-8f6e-2baf7d704b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd27e30-b87d-4491-a880-d63975568108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd27e30-b87d-4491-a880-d63975568108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880160817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2663f84e-a24f-4331-8038-169305335ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aff73aa4ec4e9ab568b5b837b61073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:52Z,use_quota=True,user_id='c6646f56b28f4429a86661e9529bc8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b696e7-b456-4561-80a0-c87203792fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b696e7-b456-4561-80a0-c87203792fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa547f22-a359-4861-a544-075df1916c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa547f22-a359-4861-a544-075df1916c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2663f84e-a24f-4331-8038-169305335ea8', 'volume_name': 'volume-2663f84e-a24f-4331-8038-169305335ea8', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945f290b-e767-40a1-ac63-63f25c100f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945f290b-e767-40a1-ac63-63f25c100f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece2a331-ffbe-4c9c-9603-d324ee2e80e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Volume 2663f84e-a24f-4331-8038-169305335ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2663f84e-a24f-4331-8038-169305335ea8', 'volume_size': 1} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880160817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2663f84e-a24f-4331-8038-169305335ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aff73aa4ec4e9ab568b5b837b61073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:52Z,use_quota=True,user_id='c6646f56b28f4429a86661e9529bc8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Creating volume 2663f84e-a24f-4331-8038-169305335ea8 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:01:52 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:01:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:52 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 1073741824 Sep 05 21:01:52 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:53 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 1073741824" returned: 0 in 0.620s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:53 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 Sep 05 21:01:53 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:53 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8" returned: 0 in 0.349s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece2a331-ffbe-4c9c-9603-d324ee2e80e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2663f84e-a24f-4331-8038-169305335ea8', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b38f6cb-4859-4209-8552-3bc80efb1c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:53 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Volume volume-2663f84e-a24f-4331-8038-169305335ea8 (2663f84e-a24f-4331-8038-169305335ea8): created successfully Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b38f6cb-4859-4209-8552-3bc80efb1c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Flow 'volume_create_manager' (28e267be-37e8-4fdc-8f6e-2baf7d704b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9887b088-7f5b-4c4b-8e82-d1597900a441 tempest-ProjectReaderTests-1702676905 None] Created volume successfully. Sep 05 21:01:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "cinder-2663f84e-a24f-4331-8038-169305335ea8-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-2663f84e-a24f-4331-8038-169305335ea8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "cinder-quobyte-2663f84e-a24f-4331-8038-169305335ea8" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-quobyte-2663f84e-a24f-4331-8038-169305335ea8" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3fe99d-767f-41cd-985a-0d743254df4c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:54 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 Sep 05 21:01:54 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:55 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8" returned: 0 in 0.497s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:55 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8 Sep 05 21:01:55 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:55 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2663f84e-a24f-4331-8038-169305335ea8" returned: 0 in 0.293s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-quobyte-2663f84e-a24f-4331-8038-169305335ea8" released by "delete_volume" :: held 0.842s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Created reservations ['b70aee5c-549c-4536-8cc0-f8aa3bc53425', '62bdbc27-4fa8-47f8-8989-99d356b5660c', '5f5481ad-8abc-4fb8-b2d3-3af051e0bdf8', 'e8abd775-c07f-4df3-9e1d-e0d6224b7dfc'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:55 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:01:55 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:55 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:01:55 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:55 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.348s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Deleted volume successfully. Sep 05 21:01:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-69bfbb0d-8f5d-4abc-b57f-d132f61e2098 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-2663f84e-a24f-4331-8038-169305335ea8-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:56 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.487s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Flow 'volume_create_manager' (d53b761a-c1c7-49a2-bfaf-945c0d23d3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b292801-bf36-44f6-8a5d-48cc39b2f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b292801-bf36-44f6-8a5d-48cc39b2f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603019739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397be182-a0b1-45cc-8c41-dcc05e8a2801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aff73aa4ec4e9ab568b5b837b61073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:56Z,use_quota=True,user_id='c6646f56b28f4429a86661e9529bc8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd90dd41-d28b-44f6-bda1-44f4757dfab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd90dd41-d28b-44f6-bda1-44f4757dfab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d93602-b728-4a6d-8e97-c98f2c7316f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d93602-b728-4a6d-8e97-c98f2c7316f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397be182-a0b1-45cc-8c41-dcc05e8a2801', 'volume_name': 'volume-397be182-a0b1-45cc-8c41-dcc05e8a2801', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65adbb63-9e60-4949-bcea-8f0818797e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65adbb63-9e60-4949-bcea-8f0818797e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cce140a-f1ce-4243-ae82-3dde3dee664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Volume 397be182-a0b1-45cc-8c41-dcc05e8a2801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397be182-a0b1-45cc-8c41-dcc05e8a2801', 'volume_size': 1} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603019739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397be182-a0b1-45cc-8c41-dcc05e8a2801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aff73aa4ec4e9ab568b5b837b61073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:56Z,use_quota=True,user_id='c6646f56b28f4429a86661e9529bc8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Creating volume 397be182-a0b1-45cc-8c41-dcc05e8a2801 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:01:56 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:01:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:56 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 1073741824 Sep 05 21:01:56 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:57 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 1073741824" returned: 0 in 0.731s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:57 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 Sep 05 21:01:57 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-b94bd001-4f55-41f0-8a79-b30a29e29533 req-d4c87bf7-0a19-453d-a728-d1b1dbb99981 tempest-TestShelveInstance-456236150 None] Terminate volume connection completed successfully. Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-b94bd001-4f55-41f0-8a79-b30a29e29533 req-d4c87bf7-0a19-453d-a728-d1b1dbb99981 tempest-TestShelveInstance-456236150 None] Deleting attachment 349aa600-8497-4fdc-84ea-ddaab755949e. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:01:57 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801" returned: 0 in 0.411s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cce140a-f1ce-4243-ae82-3dde3dee664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397be182-a0b1-45cc-8c41-dcc05e8a2801', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2555ddad-484c-4ac5-bd97-69a40fa72702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:57 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Volume volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 (397be182-a0b1-45cc-8c41-dcc05e8a2801): created successfully Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2555ddad-484c-4ac5-bd97-69a40fa72702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Flow 'volume_create_manager' (d53b761a-c1c7-49a2-bfaf-945c0d23d3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-607647cd-397d-4e0e-8a83-cd58a01d78bd tempest-ProjectReaderTests-1702676905 None] Created volume successfully. Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Acquiring lock "cinder-397be182-a0b1-45cc-8c41-dcc05e8a2801-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Flow 'volume_create_manager' (6774aa9e-764a-4423-b42d-62f916923594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b0fee4-21df-4c4a-b658-b9efc5b57e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Lock "cinder-397be182-a0b1-45cc-8c41-dcc05e8a2801-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b0fee4-21df-4c4a-b658-b9efc5b57e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-790468797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5c057e-e87d-4632-895a-8a2c2cbf1d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851f3b29cf1b4ab3884108828262ac7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:59Z,use_quota=True,user_id='6c9af75b9bd143bc9863910a3b7ce2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f23f6e-3975-4b4a-a07b-576355663968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f23f6e-3975-4b4a-a07b-576355663968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d40d82d-9bba-4a2f-b617-f78ae7ae4ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d40d82d-9bba-4a2f-b617-f78ae7ae4ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5c057e-e87d-4632-895a-8a2c2cbf1d09', 'volume_name': 'volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bba319-7ead-40da-880c-d753d6bd4d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bba319-7ead-40da-880c-d753d6bd4d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd5c81a-f6ea-40a4-bd31-945d0d944162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Volume 3d5c057e-e87d-4632-895a-8a2c2cbf1d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09', 'volume_size': 1} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-790468797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5c057e-e87d-4632-895a-8a2c2cbf1d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851f3b29cf1b4ab3884108828262ac7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:59Z,use_quota=True,user_id='6c9af75b9bd143bc9863910a3b7ce2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Creating volume 3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:01:58 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:58 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 1073741824 Sep 05 21:01:58 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Acquiring lock "cinder-quobyte-397be182-a0b1-45cc-8c41-dcc05e8a2801" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Lock "cinder-quobyte-397be182-a0b1-45cc-8c41-dcc05e8a2801" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca622c1-1406-46ec-a74f-ab62ff7fdf84]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:59 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 Sep 05 21:01:59 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:59 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 1073741824" returned: 0 in 0.575s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:59 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801" returned: 0 in 0.498s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:59 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801 Sep 05 21:01:59 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:59 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 Sep 05 21:01:59 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:59 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" returned: 0 in 0.318s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:59 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-397be182-a0b1-45cc-8c41-dcc05e8a2801" returned: 0 in 0.379s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd5c81a-f6ea-40a4-bd31-945d0d944162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655023dd-f1c6-4913-a360-f3c98ca5c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Lock "cinder-quobyte-397be182-a0b1-45cc-8c41-dcc05e8a2801" released by "delete_volume" :: held 0.942s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Volume volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 (3d5c057e-e87d-4632-895a-8a2c2cbf1d09): created successfully Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655023dd-f1c6-4913-a360-f3c98ca5c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Flow 'volume_create_manager' (6774aa9e-764a-4423-b42d-62f916923594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bfba8d9c-cc28-446b-97e9-95c86d4a7e01 tempest-TestStampPattern-957294977 None] Created volume successfully. Sep 05 21:01:59 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Created reservations ['4705c0b4-11e4-4faa-8de6-b57136d43dea', '362fb4a7-9725-4f85-a478-fd21a0b93374', '3bc0e1af-73db-4a7b-9eb7-a06ed2d56a78', '6c48508e-ea4b-4a07-b737-5328c704e420'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:00 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:02:00 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:00 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.396s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Deleted volume successfully. Sep 05 21:02:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5cd6b053-c358-4973-b16f-7bae11e6373f tempest-ProjectReaderTests-1702676905 None] Lock "cinder-397be182-a0b1-45cc-8c41-dcc05e8a2801-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Flow 'volume_create_manager' (e9b30a9b-9f6b-417d-9df4-05e0b5fb1e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f20e27-d993-4441-8f8e-86e4812f422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f20e27-d993-4441-8f8e-86e4812f422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-552904537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0cc767-fdae-4cab-860e-ec403b8d85d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aff73aa4ec4e9ab568b5b837b61073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:02Z,use_quota=True,user_id='c6646f56b28f4429a86661e9529bc8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5123bd-fa5c-4e6d-961f-b3341ea02fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5123bd-fa5c-4e6d-961f-b3341ea02fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aed28e4-af48-49e9-a804-064c3cf773d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aed28e4-af48-49e9-a804-064c3cf773d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0cc767-fdae-4cab-860e-ec403b8d85d1', 'volume_name': 'volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b115cc-a957-4263-a2f5-e81bfe89f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:01 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b115cc-a957-4263-a2f5-e81bfe89f131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357e4bf9-e80c-4c58-b6b2-bb204207a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Volume 7f0cc767-fdae-4cab-860e-ec403b8d85d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1', 'volume_size': 1} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-552904537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0cc767-fdae-4cab-860e-ec403b8d85d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aff73aa4ec4e9ab568b5b837b61073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:02Z,use_quota=True,user_id='c6646f56b28f4429a86661e9529bc8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Creating volume 7f0cc767-fdae-4cab-860e-ec403b8d85d1 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:02:02 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:02:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:02 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 1073741824 Sep 05 21:02:02 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:02 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 1073741824" returned: 0 in 0.979s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f0305605-b854-4c68-bd56-f071b09305a1 req-81773966-9bcd-4ef7-b90a-a70744a53fad tempest-TestShelveInstance-456236150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:03 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 Sep 05 21:02:03 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:03 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1" returned: 0 in 0.456s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f0305605-b854-4c68-bd56-f071b09305a1 req-81773966-9bcd-4ef7-b90a-a70744a53fad tempest-TestShelveInstance-456236150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.487s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357e4bf9-e80c-4c58-b6b2-bb204207a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed1c75f-7a57-4209-861d-1f995354ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-f0305605-b854-4c68-bd56-f071b09305a1 req-81773966-9bcd-4ef7-b90a-a70744a53fad tempest-TestShelveInstance-456236150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:03 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Volume volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 (7f0cc767-fdae-4cab-860e-ec403b8d85d1): created successfully Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed1c75f-7a57-4209-861d-1f995354ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Flow 'volume_create_manager' (e9b30a9b-9f6b-417d-9df4-05e0b5fb1e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-dffd8944-d875-4d8f-b11f-f73ddaa95619 tempest-ProjectReaderTests-1702676905 None] Created volume successfully. Sep 05 21:02:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-f0305605-b854-4c68-bd56-f071b09305a1 req-81773966-9bcd-4ef7-b90a-a70744a53fad tempest-TestShelveInstance-456236150 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-6228032e-d71a-428b-abef-2b8449f64ee9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2509ec8-b938-4cdf-bf99-34081bf22b7f', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:02:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-f0305605-b854-4c68-bd56-f071b09305a1 req-81773966-9bcd-4ef7-b90a-a70744a53fad tempest-TestShelveInstance-456236150 None] attachment_update completed successfully. Sep 05 21:02:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "cinder-7f0cc767-fdae-4cab-860e-ec403b8d85d1-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-7f0cc767-fdae-4cab-860e-ec403b8d85d1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "cinder-quobyte-7f0cc767-fdae-4cab-860e-ec403b8d85d1" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-quobyte-7f0cc767-fdae-4cab-860e-ec403b8d85d1" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:04 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1efd4-01a0-4c8a-9a3e-7c56aff8fa1f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:04 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 Sep 05 21:02:04 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:04 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1" returned: 0 in 0.465s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:04 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1 Sep 05 21:02:04 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:05 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f0cc767-fdae-4cab-860e-ec403b8d85d1" returned: 0 in 0.370s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-quobyte-7f0cc767-fdae-4cab-860e-ec403b8d85d1" released by "delete_volume" :: held 0.895s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Created reservations ['023ac774-8981-44f2-bb25-cba2e5d72e97', '64e9091b-d62a-4285-ba0e-f39fb9113e95', 'c8e061b1-45ed-4491-ae92-850ecd1a3ef0', '37907348-64a6-415c-800a-49fee0ed8bc2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:05 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:02:05 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:05 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.384s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Deleted volume successfully. Sep 05 21:02:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-cd25e979-f46d-4d4d-90a6-2ed4fc4282b7 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-7f0cc767-fdae-4cab-860e-ec403b8d85d1-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Flow 'volume_create_manager' (774f160c-bc17-4e6d-9c76-8418387b3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1108e3a1-0e40-41c7-bf2d-8491c48b7bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1108e3a1-0e40-41c7-bf2d-8491c48b7bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453521911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fa7f69-830e-4848-8beb-8af05d9229e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aff73aa4ec4e9ab568b5b837b61073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:06Z,use_quota=True,user_id='c6646f56b28f4429a86661e9529bc8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1120393a-ed42-4ff2-bd96-5f34b10d593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1120393a-ed42-4ff2-bd96-5f34b10d593d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11db0979-341a-4e6e-9a8c-5705d735b41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11db0979-341a-4e6e-9a8c-5705d735b41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fa7f69-830e-4848-8beb-8af05d9229e5', 'volume_name': 'volume-c2fa7f69-830e-4848-8beb-8af05d9229e5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805cf069-ef02-4ad1-9c62-a69350b788d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805cf069-ef02-4ad1-9c62-a69350b788d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142e5195-7d8d-4916-9bfd-d8185cd362a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:06 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Volume c2fa7f69-830e-4848-8beb-8af05d9229e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fa7f69-830e-4848-8beb-8af05d9229e5', 'volume_size': 1} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453521911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fa7f69-830e-4848-8beb-8af05d9229e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aff73aa4ec4e9ab568b5b837b61073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:06Z,use_quota=True,user_id='c6646f56b28f4429a86661e9529bc8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Creating volume c2fa7f69-830e-4848-8beb-8af05d9229e5 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:02:06 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:06 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 1073741824 Sep 05 21:02:06 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:06 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 1073741824" returned: 0 in 0.604s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:07 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 Sep 05 21:02:07 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:07 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5" returned: 0 in 0.352s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142e5195-7d8d-4916-9bfd-d8185cd362a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fa7f69-830e-4848-8beb-8af05d9229e5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0cd331-ef19-49b3-bd7a-8404f4dea61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:07 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Volume volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 (c2fa7f69-830e-4848-8beb-8af05d9229e5): created successfully Sep 05 21:02:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0cd331-ef19-49b3-bd7a-8404f4dea61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Flow 'volume_create_manager' (774f160c-bc17-4e6d-9c76-8418387b3e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:07 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-60620a2c-3d3d-4d4f-a66e-70497a99e174 tempest-ProjectReaderTests-1702676905 None] Created volume successfully. Sep 05 21:02:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "cinder-c2fa7f69-830e-4848-8beb-8af05d9229e5-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-c2fa7f69-830e-4848-8beb-8af05d9229e5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "cinder-quobyte-c2fa7f69-830e-4848-8beb-8af05d9229e5" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-quobyte-c2fa7f69-830e-4848-8beb-8af05d9229e5" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:08 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b98e394-6419-4b70-b8d3-71295ba3b8bc]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:08 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 Sep 05 21:02:08 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:09 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5" returned: 0 in 0.971s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:09 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5 Sep 05 21:02:09 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:10 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c2fa7f69-830e-4848-8beb-8af05d9229e5" returned: 0 in 0.753s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-quobyte-c2fa7f69-830e-4848-8beb-8af05d9229e5" released by "delete_volume" :: held 1.810s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Created reservations ['9622dc09-04fe-4582-88a6-b868f34c5d89', '035e8f95-9c71-4d0f-a091-9cdd331ec4fe', '3871cc00-b82a-45ed-a31f-60ce21b256b9', '7caf1eac-9a68-4386-a714-67357847a10b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:10 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:02:10 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:11 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.883s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:11 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:11 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Deleted volume successfully. Sep 05 21:02:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-34c7e2eb-44f7-4467-8fb1-5a8738133ff7 tempest-ProjectReaderTests-1702676905 None] Lock "cinder-c2fa7f69-830e-4848-8beb-8af05d9229e5-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:20 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=46,cinder:UPDATE=48,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:02:21 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=49,cinder:SELECT=29,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:02:33 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:02:33 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:02:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-d616b660-f2db-4b0a-97e0-097b7317c164 req-59f1bd23-e375-481f-8413-e55da5c5a19d tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-d616b660-f2db-4b0a-97e0-097b7317c164 req-59f1bd23-e375-481f-8413-e55da5c5a19d tempest-TestStampPattern-957294977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-d616b660-f2db-4b0a-97e0-097b7317c164 req-59f1bd23-e375-481f-8413-e55da5c5a19d tempest-TestStampPattern-957294977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-d616b660-f2db-4b0a-97e0-097b7317c164 req-59f1bd23-e375-481f-8413-e55da5c5a19d tempest-TestStampPattern-957294977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0925b9eb-b2d5-43c3-994d-c8499a98210d', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:02:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-d616b660-f2db-4b0a-97e0-097b7317c164 req-59f1bd23-e375-481f-8413-e55da5c5a19d tempest-TestStampPattern-957294977 None] attachment_update completed successfully. Sep 05 21:02:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-d46f53f7-f1f8-4495-9753-74a152e45655 req-005a6e45-55e5-4c5c-aa90-7839e7cc40ca tempest-TestStampPattern-957294977 None] Terminate volume connection completed successfully. Sep 05 21:02:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-d46f53f7-f1f8-4495-9753-74a152e45655 req-005a6e45-55e5-4c5c-aa90-7839e7cc40ca tempest-TestStampPattern-957294977 None] Deleting attachment 0925b9eb-b2d5-43c3-994d-c8499a98210d. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:02:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Creating offline snapshot de25d7a8-e3fb-4d07-afac-34230efac5d6 of volume 3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:02:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c64202-4a69-47cc-9f8a-6fe9753a7506]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:46 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 Sep 05 21:02:46 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:46 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" returned: 0 in 0.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:46 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 1G Sep 05 21:02:46 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:47 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 1G" returned: 0 in 0.398s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:47 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 Sep 05 21:02:47 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:47 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6" returned: 0 in 0.341s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:47 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 is being set with open permissions: ugo+rw Sep 05 21:02:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:47 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 Sep 05 21:02:47 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:47 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6" returned: 0 in 0.282s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:47 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.info Sep 05 21:02:47 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:48 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.info" returned: 0 in 0.269s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:48 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.info is being set with open permissions: ugo+rw Sep 05 21:02:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:48 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.info Sep 05 21:02:48 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:48 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.info" returned: 0 in 0.272s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-329e8b15-9179-42e9-b566-e15512a65c41 tempest-TestStampPattern-957294977 None] Create snapshot completed successfully Sep 05 21:02:49 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Flow 'volume_create_manager' (2f1db3c8-b893-41e4-a4f9-a58bf50569d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:49 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfb0ecb-b535-4c32-8691-aac4ee15debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfb0ecb-b535-4c32-8691-aac4ee15debe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1155060602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae4abcc-c4a6-4901-8a30-07e95722e752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79dd90dfa9e495a99b4fc1502973963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:50Z,use_quota=True,user_id='3905d0aebd5744a98f4015a49a7fae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2bbffa-a62e-4c20-99a9-3728df15db69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2bbffa-a62e-4c20-99a9-3728df15db69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b1e017-6002-47c7-b771-6272067fb18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b1e017-6002-47c7-b771-6272067fb18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae4abcc-c4a6-4901-8a30-07e95722e752', 'volume_name': 'volume-2ae4abcc-c4a6-4901-8a30-07e95722e752', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e26e48-23f4-4e9a-85bb-c4313776580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e26e48-23f4-4e9a-85bb-c4313776580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ee45cd-4d59-42fb-a28e-430485c357ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:50 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Volume 2ae4abcc-c4a6-4901-8a30-07e95722e752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae4abcc-c4a6-4901-8a30-07e95722e752', 'volume_size': 1} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1155060602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae4abcc-c4a6-4901-8a30-07e95722e752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79dd90dfa9e495a99b4fc1502973963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:50Z,use_quota=True,user_id='3905d0aebd5744a98f4015a49a7fae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Creating volume 2ae4abcc-c4a6-4901-8a30-07e95722e752 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:02:50 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:50 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 1073741824 Sep 05 21:02:50 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:50 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 1073741824" returned: 0 in 0.602s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:50 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 Sep 05 21:02:50 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:51 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752" returned: 0 in 0.364s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ee45cd-4d59-42fb-a28e-430485c357ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae4abcc-c4a6-4901-8a30-07e95722e752', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0889386-40a4-42fc-9ed7-d3a4ba9a8a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:51 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Volume volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 (2ae4abcc-c4a6-4901-8a30-07e95722e752): created successfully Sep 05 21:02:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0889386-40a4-42fc-9ed7-d3a4ba9a8a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Flow 'volume_create_manager' (2f1db3c8-b893-41e4-a4f9-a58bf50569d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-eed1ff60-5ba7-4cab-8cd5-8c45dff482e1 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Created volume successfully. Sep 05 21:02:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c40b682d-fe42-4452-bcc5-f5d9f9ddb6f3 req-6cf70ac5-0ab8-47ea-b626-e17e30ccfc3e tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c40b682d-fe42-4452-bcc5-f5d9f9ddb6f3 req-6cf70ac5-0ab8-47ea-b626-e17e30ccfc3e tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c40b682d-fe42-4452-bcc5-f5d9f9ddb6f3 req-6cf70ac5-0ab8-47ea-b626-e17e30ccfc3e tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-c40b682d-fe42-4452-bcc5-f5d9f9ddb6f3 req-6cf70ac5-0ab8-47ea-b626-e17e30ccfc3e tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-2ae4abcc-c4a6-4901-8a30-07e95722e752', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00e25fb0-7d5e-42db-8b29-89353c48f395', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:02:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-f2037082-4fb5-4969-ba9b-8d7fe8c1135a tempest-TestShelveInstance-456236150 None] Terminate volume connection completed successfully. Sep 05 21:02:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-f2037082-4fb5-4969-ba9b-8d7fe8c1135a tempest-TestShelveInstance-456236150 None] Deleting attachment d2509ec8-b938-4cdf-bf99-34081bf22b7f. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:02:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-c40b682d-fe42-4452-bcc5-f5d9f9ddb6f3 req-6cf70ac5-0ab8-47ea-b626-e17e30ccfc3e tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] attachment_update completed successfully. Sep 05 21:02:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Acquiring lock "cinder-6228032e-d71a-428b-abef-2b8449f64ee9-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Lock "cinder-6228032e-d71a-428b-abef-2b8449f64ee9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Acquiring lock "cinder-quobyte-6228032e-d71a-428b-abef-2b8449f64ee9" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Lock "cinder-quobyte-6228032e-d71a-428b-abef-2b8449f64ee9" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be6d35-204c-4e4a-8e14-8f5cbc6ebbbe]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:54 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 Sep 05 21:02:54 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:54 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9" returned: 0 in 0.603s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:54 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9 Sep 05 21:02:54 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:54 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6228032e-d71a-428b-abef-2b8449f64ee9" returned: 0 in 0.287s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Lock "cinder-quobyte-6228032e-d71a-428b-abef-2b8449f64ee9" released by "delete_volume" :: held 0.944s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.quota [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Created reservations ['3b8500ab-db5f-4aaa-872d-37f09ac5e127', '432d8bde-78fb-44d8-9054-1328a0945d29', '39aa40ef-9eb1-443b-9052-3850eb43a2a7', '9e85b953-c3d3-43e8-82ed-3c2d3dd3b921'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:55 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:02:55 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:55 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.293s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.manager [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Deleted volume successfully. Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [req-551c53ca-63eb-4f83-abbf-6f80debfaf24 req-a8677705-2b5d-4133-86e4-c9998c1396cf tempest-TestShelveInstance-456236150 None] Lock "cinder-6228032e-d71a-428b-abef-2b8449f64ee9-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:55 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:02:55 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:55 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.303s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:02:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:02:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:02:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-53acd6ce-7952-409a-9c1e-359b4627ead3 req-d3b82c9e-3936-43d8-bd66-0c4db17f5bd4 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Terminate volume connection completed successfully. Sep 05 21:02:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-53acd6ce-7952-409a-9c1e-359b4627ead3 req-d3b82c9e-3936-43d8-bd66-0c4db17f5bd4 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Deleting attachment 00e25fb0-7d5e-42db-8b29-89353c48f395. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Acquiring lock "cinder-2ae4abcc-c4a6-4901-8a30-07e95722e752-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "cinder-2ae4abcc-c4a6-4901-8a30-07e95722e752-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Acquiring lock "cinder-quobyte-2ae4abcc-c4a6-4901-8a30-07e95722e752" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "cinder-quobyte-2ae4abcc-c4a6-4901-8a30-07e95722e752" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be924fa-2f69-43a8-add3-b99b2ca0c54f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:58 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 Sep 05 21:02:58 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:58 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752" returned: 0 in 0.415s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:58 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752 Sep 05 21:02:58 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Flow 'volume_create_manager' (b4b19ff6-3ef5-4fb9-ac72-b8b731f6bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3662b4b-61fc-46e6-9d7c-9470332706ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3662b4b-61fc-46e6-9d7c-9470332706ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1587983594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c41f109-3fb2-4fa0-9de9-07e4ca95e69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851f3b29cf1b4ab3884108828262ac7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de25d7a8-e3fb-4d07-afac-34230efac5d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:59Z,use_quota=True,user_id='6c9af75b9bd143bc9863910a3b7ce2ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d92a14-9ac7-4995-9fb2-1a1adc2f6a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d92a14-9ac7-4995-9fb2-1a1adc2f6a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ac3969-9535-4eaf-a621-5ef5ce2f4cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:59 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ac3969-9535-4eaf-a621-5ef5ce2f4cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c41f109-3fb2-4fa0-9de9-07e4ca95e69d', 'volume_name': 'volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d', 'volume_size': 1, 'snapshot_id': 'de25d7a8-e3fb-4d07-afac-34230efac5d6'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeef6d0a-9fb9-4fea-8842-5088edefa3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeef6d0a-9fb9-4fea-8842-5088edefa3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7faf331-0743-49c8-bfb6-647332fa87d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Volume 8c41f109-3fb2-4fa0-9de9-07e4ca95e69d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d', 'volume_size': 1, 'snapshot_id': 'de25d7a8-e3fb-4d07-afac-34230efac5d6'} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2ae4abcc-c4a6-4901-8a30-07e95722e752" returned: 0 in 0.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-quobyte-de25d7a8-e3fb-4d07-afac-34230efac5d6-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "cinder-quobyte-2ae4abcc-c4a6-4901-8a30-07e95722e752" released by "delete_volume" :: held 0.830s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-de25d7a8-e3fb-4d07-afac-34230efac5d6-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Creating volume 8c41f109-3fb2-4fa0-9de9-07e4ca95e69d from snapshot de25d7a8-e3fb-4d07-afac-34230efac5d6 {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-quobyte-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] snapshot: de25d7a8-e3fb-4d07-afac-34230efac5d6, volume: 8c41f109-3fb2-4fa0-9de9-07e4ca95e69d, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd71ca0-7250-4fe8-8df2-fa2eb6addf4f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Created reservations ['e270dd36-70fa-4cf6-b34f-6bfddf54b246', 'aa7396d7-77d4-4360-8b87-a308224fce64', 'd01eb2d0-11d0-4e4f-b60c-673e10a7525a', '93d080b7-c3c4-42e4-a6c7-70eb5050779d'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:59 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:02:59 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:59 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 Sep 05 21:02:59 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:59 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.334s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Deleted volume successfully. Sep 05 21:02:59 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6" returned: 0 in 0.505s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3553a3b9-b6a7-47f8-89e3-bc276506c321 tempest-TestServerVolumeAttachScenarioOldVersion-948095514 None] Lock "cinder-2ae4abcc-c4a6-4901-8a30-07e95722e752-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8192e337-2909-45bc-b2cf-db1ce5700690]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:59 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 Sep 05 21:02:59 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:00 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" returned: 0 in 0.674s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 21:03:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 21:03:00 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:03:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:00 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d Sep 05 21:03:00 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:06 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" returned: 0 in 6.530s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:06 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:03:06 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Converted 1024.00 MB image at 156.77 MB/s Sep 05 21:03:06 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d is being set with open permissions: ugo+rw Sep 05 21:03:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:07 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d Sep 05 21:03:07 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:07 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" released by "_copy_volume_from_snapshot" :: held 8.200s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:03:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-de25d7a8-e3fb-4d07-afac-34230efac5d6-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" released by "_create_volume_from_snapshot" :: held 8.327s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:03:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.350s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7faf331-0743-49c8-bfb6-647332fa87d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d', 'volume_size': 1, 'snapshot_id': 'de25d7a8-e3fb-4d07-afac-34230efac5d6'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141109fb-5d80-43ab-a8de-b910dca789a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:07 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Volume volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d (8c41f109-3fb2-4fa0-9de9-07e4ca95e69d): created successfully Sep 05 21:03:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141109fb-5d80-43ab-a8de-b910dca789a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Flow 'volume_create_manager' (b4b19ff6-3ef5-4fb9-ac72-b8b731f6bf93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:03:07 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ad11f7e9-5796-46b4-9cbf-19478eb677e7 tempest-TestStampPattern-957294977 None] Created volume successfully. Sep 05 21:03:17 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=37,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:03:17 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=33,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Flow 'volume_create_manager' (cdd446b9-2747-4be7-865f-5e5e721f7132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c98528d-8ea1-4513-8659-7df461814cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c98528d-8ea1-4513-8659-7df461814cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1911066454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8089d7c5-cd1d-4e47-9bea-fc11201b0a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa06b1f5a3b440f180258ccc88d24532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:44Z,use_quota=True,user_id='9c87e0f4fd374dff8796ad0b1294b176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cd38b5-cf05-4db6-9aac-aa266dc64686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cd38b5-cf05-4db6-9aac-aa266dc64686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99df677c-0435-46c8-ac98-6f0041cb8525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99df677c-0435-46c8-ac98-6f0041cb8525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8089d7c5-cd1d-4e47-9bea-fc11201b0a65', 'volume_name': 'volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784f4512-495c-4436-b96b-245e69bbca25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784f4512-495c-4436-b96b-245e69bbca25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917f1f8e-6213-46f4-8db9-239e5c0d0a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:44 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Volume 8089d7c5-cd1d-4e47-9bea-fc11201b0a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65', 'volume_size': 1} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1911066454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8089d7c5-cd1d-4e47-9bea-fc11201b0a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa06b1f5a3b440f180258ccc88d24532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:44Z,use_quota=True,user_id='9c87e0f4fd374dff8796ad0b1294b176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Creating volume 8089d7c5-cd1d-4e47-9bea-fc11201b0a65 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:03:44 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:44 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 1073741824 Sep 05 21:03:44 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:44 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 1073741824" returned: 0 in 0.453s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:44 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 Sep 05 21:03:44 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:45 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" returned: 0 in 0.258s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:03:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917f1f8e-6213-46f4-8db9-239e5c0d0a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d145c8-2321-4789-9c56-e6844abad27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:45 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Volume volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 (8089d7c5-cd1d-4e47-9bea-fc11201b0a65): created successfully Sep 05 21:03:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d145c8-2321-4789-9c56-e6844abad27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Flow 'volume_create_manager' (cdd446b9-2747-4be7-865f-5e5e721f7132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:03:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-cdef1062-1f2a-4e68-93f7-7390f26bde35 tempest-TestImageHashVerification-1454297305 None] Created volume successfully. Sep 05 21:03:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1d0118-7ffa-48a8-8e6c-58019302f8dd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:03:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:46 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 Sep 05 21:03:46 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:46 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" returned: 0 in 0.374s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ea7844-b810-4755-8bbc-88c33c9e78e7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:03:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:47 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 Sep 05 21:03:47 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:47 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" returned: 0 in 0.391s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 /opt/stack/data/cinder/conversion/8089d7c5-cd1d-4e47-9bea-fc11201b0a65.temp_image.3346ba2a-de83-4799-abf1-d09e44ca2881bk32z53q.img {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:47 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 /opt/stack/data/cinder/conversion/8089d7c5-cd1d-4e47-9bea-fc11201b0a65.temp_image.3346ba2a-de83-4799-abf1-d09e44ca2881bk32z53q.img Sep 05 21:03:47 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:52 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 /opt/stack/data/cinder/conversion/8089d7c5-cd1d-4e47-9bea-fc11201b0a65.temp_image.3346ba2a-de83-4799-abf1-d09e44ca2881bk32z53q.img" returned: 0 in 5.305s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc124e0-daf7-4c0c-80e7-8cebf59c8766]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:03:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:52 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 Sep 05 21:03:52 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:53 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" returned: 0 in 0.546s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:53 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/conversion/8089d7c5-cd1d-4e47-9bea-fc11201b0a65.temp_image.3346ba2a-de83-4799-abf1-d09e44ca2881bk32z53q.img {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:03:53 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Converted 1024.00 MB image at 192.97 MB/s Sep 05 21:03:53 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] 3346ba2a-de83-4799-abf1-d09e44ca2881 was raw, no need to convert to raw {{(pid=87802) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 21:03:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c97bfc59-2ede-4555-8efb-299f7edffcde req-12e3ee85-49e9-471f-b6e7-288cff46a467 tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:03:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:03:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:03:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:55 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:03:55 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:56 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.337s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Flow 'volume_create_manager' (a24b043e-f59e-4d68-bc7b-69e3935b5a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8265c79f-a783-4ba1-ae99-303e264d2bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8265c79f-a783-4ba1-ae99-303e264d2bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1594206090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354b8394-453c-4d69-a929-ef7672f08a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c77112f5a7428aa22acc43f6aa5751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:56Z,use_quota=True,user_id='de4ee16d23a64cd98b4fb23d719557b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc201115-0e9b-4ae8-80d5-f5bbf3314d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc201115-0e9b-4ae8-80d5-f5bbf3314d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f348b67-4274-4b29-9798-3c1d46c19847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f348b67-4274-4b29-9798-3c1d46c19847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354b8394-453c-4d69-a929-ef7672f08a62', 'volume_name': 'volume-354b8394-453c-4d69-a929-ef7672f08a62', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f1f0ee-59c8-4683-a42f-29440c5e7213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f1f0ee-59c8-4683-a42f-29440c5e7213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74edb35-32b3-4af3-ae09-6b567f8070cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:56 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Volume 354b8394-453c-4d69-a929-ef7672f08a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354b8394-453c-4d69-a929-ef7672f08a62', 'volume_size': 1} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Flow 'volume_create_manager' (f629e549-38d6-496b-8c04-f51db2120f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:03:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ef2be6-fbd7-4177-a300-760362778ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ef2be6-fbd7-4177-a300-760362778ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-982576263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf786e9-8fcb-417b-a885-3e104d40b6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c77112f5a7428aa22acc43f6aa5751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:57Z,use_quota=True,user_id='de4ee16d23a64cd98b4fb23d719557b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d893da-44b2-4479-ad14-78cb1aca2f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d893da-44b2-4479-ad14-78cb1aca2f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67b3f29-2606-41d9-9e7c-b005f4ef8697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67b3f29-2606-41d9-9e7c-b005f4ef8697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf786e9-8fcb-417b-a885-3e104d40b6c5', 'volume_name': 'volume-abf786e9-8fcb-417b-a885-3e104d40b6c5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aace48e0-5bf3-42d4-a766-f02753a749a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aace48e0-5bf3-42d4-a766-f02753a749a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ce713d-9261-4541-9a7e-df01a13d5733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:57 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Volume abf786e9-8fcb-417b-a885-3e104d40b6c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf786e9-8fcb-417b-a885-3e104d40b6c5', 'volume_size': 1} Sep 05 21:03:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:06 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:04:06 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.720s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Uploaded volume to glance image-id: 3346ba2a-de83-4799-abf1-d09e44ca2881. {{(pid=87802) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c97bfc59-2ede-4555-8efb-299f7edffcde req-12e3ee85-49e9-471f-b6e7-288cff46a467 tempest-TestStampPattern-957294977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 20.818s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-c97bfc59-2ede-4555-8efb-299f7edffcde req-12e3ee85-49e9-471f-b6e7-288cff46a467 tempest-TestStampPattern-957294977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.673s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1594206090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354b8394-453c-4d69-a929-ef7672f08a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c77112f5a7428aa22acc43f6aa5751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:56Z,use_quota=True,user_id='de4ee16d23a64cd98b4fb23d719557b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Creating volume 354b8394-453c-4d69-a929-ef7672f08a62 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:16 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-652c5869-0e98-4b50-a5aa-c87bf7e0df36 tempest-TestImageHashVerification-1454297305 None] Copy volume to image completed successfully. Sep 05 21:04:16 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 1073741824 Sep 05 21:04:16 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-c97bfc59-2ede-4555-8efb-299f7edffcde req-12e3ee85-49e9-471f-b6e7-288cff46a467 tempest-TestStampPattern-957294977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e528140-c37b-4d0e-832f-17d558b0f8fc', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:04:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-c97bfc59-2ede-4555-8efb-299f7edffcde req-12e3ee85-49e9-471f-b6e7-288cff46a467 tempest-TestStampPattern-957294977 None] attachment_update completed successfully. Sep 05 21:04:16 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 1073741824" returned: 0 in 0.636s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:16 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 Sep 05 21:04:16 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:17 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62" returned: 0 in 0.355s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.260s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-982576263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf786e9-8fcb-417b-a885-3e104d40b6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c77112f5a7428aa22acc43f6aa5751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:57Z,use_quota=True,user_id='de4ee16d23a64cd98b4fb23d719557b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Creating volume abf786e9-8fcb-417b-a885-3e104d40b6c5 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:17 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74edb35-32b3-4af3-ae09-6b567f8070cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354b8394-453c-4d69-a929-ef7672f08a62', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:17 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 1073741824 Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2445e486-c557-417d-ac3b-40fd4f82d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:17 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:17 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Volume volume-354b8394-453c-4d69-a929-ef7672f08a62 (354b8394-453c-4d69-a929-ef7672f08a62): created successfully Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2445e486-c557-417d-ac3b-40fd4f82d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Flow 'volume_create_manager' (a24b043e-f59e-4d68-bc7b-69e3935b5a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:17 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0f316500-8bdb-4da7-a62b-31d5c8ab4f30 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Created volume successfully. Sep 05 21:04:17 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Acquiring lock "cinder-8089d7c5-cd1d-4e47-9bea-fc11201b0a65-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 1073741824" returned: 0 in 0.542s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Lock "cinder-8089d7c5-cd1d-4e47-9bea-fc11201b0a65-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Acquiring lock "cinder-quobyte-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:17 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 Sep 05 21:04:17 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Lock "cinder-quobyte-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" acquired by "delete_volume" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4505674-bbad-4568-ae15-e32b1d8b0ade]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:18 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 Sep 05 21:04:18 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:18 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5" returned: 0 in 0.294s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ce713d-9261-4541-9a7e-df01a13d5733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf786e9-8fcb-417b-a885-3e104d40b6c5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ba422e-7f0c-4209-a41f-1b664f701e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:18 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Volume volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 (abf786e9-8fcb-417b-a885-3e104d40b6c5): created successfully Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ba422e-7f0c-4209-a41f-1b664f701e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Flow 'volume_create_manager' (f629e549-38d6-496b-8c04-f51db2120f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c51e75fd-2f25-4416-b921-7eff043269fc tempest-TestServerVolumeAttachmentScenario-1777905331 None] Created volume successfully. Sep 05 21:04:18 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" returned: 0 in 0.396s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:18 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65 Sep 05 21:04:18 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:18 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" returned: 0 in 0.244s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Lock "cinder-quobyte-8089d7c5-cd1d-4e47-9bea-fc11201b0a65" released by "delete_volume" :: held 0.690s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Created reservations ['f4e3665f-c721-4f95-96cb-133b025281fb', '812a9255-de3f-42c8-9f47-bcdb9a117a85', '5270fe32-9649-4ca0-a5aa-cd7bcff1f2a4', '3efbb599-4a06-4a1e-9604-3ea62d8c33c3'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:18 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:18 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:19 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.314s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:19 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Deleted volume successfully. Sep 05 21:04:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8c5a5cca-e0ac-439c-99aa-e6c1fec8ccfb tempest-TestImageHashVerification-1454297305 None] Lock "cinder-8089d7c5-cd1d-4e47-9bea-fc11201b0a65-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-a3c5068f-fa00-4285-9392-bf98aa47e18b req-9ad82179-0650-4c68-a5c4-6702fe748a0f tempest-TestStampPattern-957294977 None] Terminate volume connection completed successfully. Sep 05 21:04:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-a3c5068f-fa00-4285-9392-bf98aa47e18b req-9ad82179-0650-4c68-a5c4-6702fe748a0f tempest-TestStampPattern-957294977 None] Deleting attachment 7e528140-c37b-4d0e-832f-17d558b0f8fc. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:04:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Lock "cinder-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-quobyte-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5819b9b7-120a-4434-8ff5-15896db83fe8]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:24 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d Sep 05 21:04:24 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:25 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" returned: 0 in 0.398s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:25 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d Sep 05 21:04:25 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:25 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" returned: 0 in 0.249s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d" released by "delete_volume" :: held 0.688s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Created reservations ['303a5dff-84cb-4202-8f0d-00377f934e4a', '3e130277-17b1-4ef6-927f-94191833b4e6', 'c80589a5-33cc-49fd-bc1a-876657223ba7', 'b377dbde-a8fd-44ac-a894-80f213cbde96'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:25 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:25 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:25 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.328s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:25 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Deleted volume successfully. Sep 05 21:04:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-75f49f5b-e745-457a-a233-65827dc84c7e tempest-TestStampPattern-957294977 None] Lock "cinder-8c41f109-3fb2-4fa0-9de9-07e4ca95e69d-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-de25d7a8-e3fb-4d07-afac-34230efac5d6-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Lock "cinder-de25d7a8-e3fb-4d07-afac-34230efac5d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-quobyte-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-quobyte-de25d7a8-e3fb-4d07-afac-34230efac5d6" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-de25d7a8-e3fb-4d07-afac-34230efac5d6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Deleting offline snapshot de25d7a8-e3fb-4d07-afac-34230efac5d6 of volume 3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] snapshot_file for this snap is: volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[239253bd-4500-4980-b8ae-1c153e6ec7f4]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:26 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 Sep 05 21:04:26 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:26 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6" returned: 0 in 0.392s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe880017-5e93-4649-a55c-55d4fa9e8d37]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:26 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 Sep 05 21:04:26 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:27 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" returned: 0 in 0.542s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:27 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 Sep 05 21:04:27 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:27 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6" returned: 0 in 0.338s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:27 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6 Sep 05 21:04:27 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:27 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09.de25d7a8-e3fb-4d07-afac-34230efac5d6" returned: 0 in 0.292s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-de25d7a8-e3fb-4d07-afac-34230efac5d6" released by "_delete_snapshot" :: held 1.741s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" released by "delete_snapshot" :: held 1.773s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:28 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Created reservations ['2dc43a32-4516-47c4-bdf8-50e686527a38', '76edc73c-e7df-4725-acb6-01ce1f9c58a0', '865b19f4-49b8-4a5c-9a26-488c43e299d7', '3d146c80-665c-4ec1-9320-d3af332a482f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Delete snapshot completed successfully. Sep 05 21:04:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6c7780c3-0999-4495-afa5-cd315e51b62d tempest-TestStampPattern-957294977 None] Lock "cinder-de25d7a8-e3fb-4d07-afac-34230efac5d6-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-e89ab4f8-2cf4-4f78-95d5-eeaf8676623d req-ebdf0012-6aa7-4945-9703-b959b5a392c8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-e89ab4f8-2cf4-4f78-95d5-eeaf8676623d req-ebdf0012-6aa7-4945-9703-b959b5a392c8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-e89ab4f8-2cf4-4f78-95d5-eeaf8676623d req-ebdf0012-6aa7-4945-9703-b959b5a392c8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-e89ab4f8-2cf4-4f78-95d5-eeaf8676623d req-ebdf0012-6aa7-4945-9703-b959b5a392c8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-354b8394-453c-4d69-a929-ef7672f08a62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17c6cc75-f515-42db-a962-87f534a9e7c5', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:04:31 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-e89ab4f8-2cf4-4f78-95d5-eeaf8676623d req-ebdf0012-6aa7-4945-9703-b959b5a392c8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] attachment_update completed successfully. Sep 05 21:04:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-3d5c057e-e87d-4632-895a-8a2c2cbf1d09-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Lock "cinder-3d5c057e-e87d-4632-895a-8a2c2cbf1d09-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Acquiring lock "cinder-quobyte-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:32 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a17fb1-5f73-47ff-9d85-6d459a496145]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:32 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 Sep 05 21:04:32 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:32 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" returned: 0 in 0.359s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:32 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09 Sep 05 21:04:32 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:33 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" returned: 0 in 0.272s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Lock "cinder-quobyte-3d5c057e-e87d-4632-895a-8a2c2cbf1d09" released by "delete_volume" :: held 0.702s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Created reservations ['49e6dac5-1c11-42be-bcab-bafb222aef82', '8c69bc14-153c-4dd3-a94d-65b5820f5bd8', 'a3ecdbdf-98d8-4668-9985-74c60836a563', '5e037623-62e8-46e2-bfa5-35198dfe9a22'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (971d699c-b00f-4e60-bc36-6de96690938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b22deb-c0a8-476b-ac91-62481f383a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b22deb-c0a8-476b-ac91-62481f383a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-467598841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2afd43e-0f39-478c-a399-2d2087796779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:33Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f520ac2-426a-4b45-a656-f2156990edd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f520ac2-426a-4b45-a656-f2156990edd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2c26e5-c679-48ea-944f-0140e56b6af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2c26e5-c679-48ea-944f-0140e56b6af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2afd43e-0f39-478c-a399-2d2087796779', 'volume_name': 'volume-f2afd43e-0f39-478c-a399-2d2087796779', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8502e4e1-d586-4454-89e9-7a8ae0b02630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8502e4e1-d586-4454-89e9-7a8ae0b02630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cb6001-eda9-416e-be76-60c3e4b261f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:33 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume f2afd43e-0f39-478c-a399-2d2087796779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2afd43e-0f39-478c-a399-2d2087796779', 'volume_size': 1} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-467598841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2afd43e-0f39-478c-a399-2d2087796779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:33Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Creating volume f2afd43e-0f39-478c-a399-2d2087796779 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:33 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:33 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 1073741824 Sep 05 21:04:33 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:33 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:33 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:33 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.271s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:33 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Deleted volume successfully. Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-62f2a0e2-0506-48cc-8e3a-8f0bbc322635 tempest-TestStampPattern-957294977 None] Lock "cinder-3d5c057e-e87d-4632-895a-8a2c2cbf1d09-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:33 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 1073741824" returned: 0 in 0.540s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:33 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 Sep 05 21:04:33 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:34 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779" returned: 0 in 0.305s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cb6001-eda9-416e-be76-60c3e4b261f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2afd43e-0f39-478c-a399-2d2087796779', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8306ed-ffff-4956-89ae-a0ce467c4eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:34 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume volume-f2afd43e-0f39-478c-a399-2d2087796779 (f2afd43e-0f39-478c-a399-2d2087796779): created successfully Sep 05 21:04:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8306ed-ffff-4956-89ae-a0ce467c4eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (971d699c-b00f-4e60-bc36-6de96690938c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:34 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-20467b3a-cae6-4f49-8e5a-8f708eaeb3b1 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created volume successfully. Sep 05 21:04:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Creating offline snapshot 6a7842d8-ef79-4f45-98a0-5c7b8953900f of volume f2afd43e-0f39-478c-a399-2d2087796779 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:04:35 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbcd161-a0c0-4ff0-aabf-12aeda727a39]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:35 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 Sep 05 21:04:35 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-79386035-656a-4672-a1c2-a60ee4031305 req-43a59d0d-ad88-4ded-ac88-9ef24c8a9b03 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:36 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779" returned: 0 in 0.454s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:36 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f 1G Sep 05 21:04:36 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:36 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f 1G" returned: 0 in 0.448s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2afd43e-0f39-478c-a399-2d2087796779 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:36 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2afd43e-0f39-478c-a399-2d2087796779 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f Sep 05 21:04:36 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:37 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2afd43e-0f39-478c-a399-2d2087796779 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f" returned: 0 in 0.489s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:37 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f is being set with open permissions: ugo+rw Sep 05 21:04:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:37 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f Sep 05 21:04:37 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:37 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f" returned: 0 in 0.263s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:37 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.info Sep 05 21:04:37 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:37 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.info" returned: 0 in 0.295s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:37 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.info is being set with open permissions: ugo+rw Sep 05 21:04:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:37 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.info Sep 05 21:04:37 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:38 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.info" returned: 0 in 0.300s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-79386035-656a-4672-a1c2-a60ee4031305 req-43a59d0d-ad88-4ded-ac88-9ef24c8a9b03 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.968s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [req-79386035-656a-4672-a1c2-a60ee4031305 req-43a59d0d-ad88-4ded-ac88-9ef24c8a9b03 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8bdfca35-8b4b-48eb-aa00-f85efc163869 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Create snapshot completed successfully Sep 05 21:04:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-79386035-656a-4672-a1c2-a60ee4031305 req-43a59d0d-ad88-4ded-ac88-9ef24c8a9b03 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c', 'name': 'volume-abf786e9-8fcb-417b-a885-3e104d40b6c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba1a9129-2086-4201-b726-179636ca1929', 'enforce_multipath': True} {{(pid=87802) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:04:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-79386035-656a-4672-a1c2-a60ee4031305 req-43a59d0d-ad88-4ded-ac88-9ef24c8a9b03 tempest-TestServerVolumeAttachmentScenario-1777905331 None] attachment_update completed successfully. Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (ed9642e2-16f0-416d-9b3f-2254a62029a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77646a4b-b805-4590-9fc4-13e9bc3a95f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77646a4b-b805-4590-9fc4-13e9bc3a95f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-146265355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25be8dc7-c9da-4412-a641-85e6d2c5aea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:39Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef57b6cd-b3aa-4682-bdf6-6beec6e7fdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef57b6cd-b3aa-4682-bdf6-6beec6e7fdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3490ca46-92c4-4752-9d31-40d9021f4e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3490ca46-92c4-4752-9d31-40d9021f4e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25be8dc7-c9da-4412-a641-85e6d2c5aea1', 'volume_name': 'volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcba033-15f5-432c-bd59-267cd147488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcba033-15f5-432c-bd59-267cd147488f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d310961-eb93-4543-ab68-45275c542f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:39 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume 25be8dc7-c9da-4412-a641-85e6d2c5aea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1', 'volume_size': 1} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-146265355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25be8dc7-c9da-4412-a641-85e6d2c5aea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:39Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Creating volume 25be8dc7-c9da-4412-a641-85e6d2c5aea1 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:39 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:39 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 1073741824 Sep 05 21:04:39 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (a3b4b413-d60c-4a4c-88ed-dd8e71206f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89064968-0c6b-4510-ad26-713e212d5e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89064968-0c6b-4510-ad26-713e212d5e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264430200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22bdc55-5351-4e39-9644-597e5ca93951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:40Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6feeb2-4533-4e15-b2d6-d46370712f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6feeb2-4533-4e15-b2d6-d46370712f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58b022c-6df9-4f62-8400-d76ecc127836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58b022c-6df9-4f62-8400-d76ecc127836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22bdc55-5351-4e39-9644-597e5ca93951', 'volume_name': 'volume-c22bdc55-5351-4e39-9644-597e5ca93951', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1becb7b-084e-49c8-b48b-99e4d736ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1becb7b-084e-49c8-b48b-99e4d736ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906b8fe1-ec8e-4b38-a897-318de8c49c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume c22bdc55-5351-4e39-9644-597e5ca93951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22bdc55-5351-4e39-9644-597e5ca93951', 'volume_size': 1} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-a467f7db-aeb8-4470-bb8b-493f5e9e6271 req-70f489ff-7b63-4e28-b502-b42373fd9e13 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Terminate volume connection completed successfully. Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-a467f7db-aeb8-4470-bb8b-493f5e9e6271 req-70f489ff-7b63-4e28-b502-b42373fd9e13 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Deleting attachment ba1a9129-2086-4201-b726-179636ca1929. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:04:40 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 1073741824" returned: 0 in 0.802s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (0a937382-b160-481c-9d37-994a62329b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2948f8f5-71fa-4ceb-9f3e-787cf18fc67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2948f8f5-71fa-4ceb-9f3e-787cf18fc67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68935754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11640889-4bfb-4827-856b-c554a09baefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:40Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361e4dfa-5fa7-4d2f-b157-5de6cb1b6e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361e4dfa-5fa7-4d2f-b157-5de6cb1b6e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad85b73c-15d3-457a-8254-54743e00cfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad85b73c-15d3-457a-8254-54743e00cfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11640889-4bfb-4827-856b-c554a09baefd', 'volume_name': 'volume-11640889-4bfb-4827-856b-c554a09baefd', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9306579-0b24-4827-901c-871e33a17fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9306579-0b24-4827-901c-871e33a17fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb30a09c-a56e-4793-8762-6c00139b130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume 11640889-4bfb-4827-856b-c554a09baefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11640889-4bfb-4827-856b-c554a09baefd', 'volume_size': 1} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:40 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 Sep 05 21:04:40 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:40 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1" returned: 0 in 0.304s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264430200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22bdc55-5351-4e39-9644-597e5ca93951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:40Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Creating volume c22bdc55-5351-4e39-9644-597e5ca93951 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:40 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:40 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 1073741824 Sep 05 21:04:40 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (9531f9ab-5de7-4f76-8452-d836e01aec70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:40 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cea767-14bb-43b9-be54-b5b0c07aa235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d310961-eb93-4543-ab68-45275c542f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453a40a5-f485-47f1-91a7-afab18758b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cea767-14bb-43b9-be54-b5b0c07aa235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-9249082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4843a709-ff3a-41a4-a816-e3a47f74ff5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:41Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca944c1-9627-4a2f-8b3b-be3c725d7dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca944c1-9627-4a2f-8b3b-be3c725d7dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9933ee-c274-450a-b188-85ba71e31f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9933ee-c274-450a-b188-85ba71e31f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4843a709-ff3a-41a4-a816-e3a47f74ff5b', 'volume_name': 'volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35225496-059b-420a-b4b4-07b093a10e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35225496-059b-420a-b4b4-07b093a10e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157a1b53-dd06-4e92-91b1-5e6249f00b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume 4843a709-ff3a-41a4-a816-e3a47f74ff5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b', 'volume_size': 1} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 (25be8dc7-c9da-4412-a641-85e6d2c5aea1): created successfully Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453a40a5-f485-47f1-91a7-afab18758b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (ed9642e2-16f0-416d-9b3f-2254a62029a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-13c5aa1e-978a-411c-be3f-16b11b7ca683 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created volume successfully. Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (340c2ce3-5a06-4d56-8218-5d70fc2699c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0f3eb7-8ef3-4f85-8613-92d5a8ec7079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0f3eb7-8ef3-4f85-8613-92d5a8ec7079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2052524604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d758dd-13f6-4c4a-beec-816f282b5ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:41Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee026b3-88eb-43b9-b13e-9261e3485dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee026b3-88eb-43b9-b13e-9261e3485dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd8438a-3629-4d75-bf21-e4fc69592d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd8438a-3629-4d75-bf21-e4fc69592d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d758dd-13f6-4c4a-beec-816f282b5ac6', 'volume_name': 'volume-04d758dd-13f6-4c4a-beec-816f282b5ac6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7dd021-d42a-4570-89c3-51f484ec2562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7dd021-d42a-4570-89c3-51f484ec2562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fd4d63-199c-422a-9cfa-17f2fad1b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume 04d758dd-13f6-4c4a-beec-816f282b5ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d758dd-13f6-4c4a-beec-816f282b5ac6', 'volume_size': 1} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:41 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 1073741824" returned: 0 in 0.762s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:41 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 Sep 05 21:04:41 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:42 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951" returned: 0 in 0.377s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68935754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11640889-4bfb-4827-856b-c554a09baefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:40Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Creating volume 11640889-4bfb-4827-856b-c554a09baefd {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:42 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:42 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd 1073741824 Sep 05 21:04:42 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906b8fe1-ec8e-4b38-a897-318de8c49c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22bdc55-5351-4e39-9644-597e5ca93951', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3bf690-897e-4486-922a-be452a22ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [req-0670c661-0065-4834-9623-677ba5e92068 req-9d2b12dc-389f-4e92-9f23-8cfdbc5e4b8b tempest-TestServerVolumeAttachmentScenario-1777905331 None] Terminate volume connection completed successfully. Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [req-0670c661-0065-4834-9623-677ba5e92068 req-9d2b12dc-389f-4e92-9f23-8cfdbc5e4b8b tempest-TestServerVolumeAttachmentScenario-1777905331 None] Deleting attachment 17c6cc75-f515-42db-a962-87f534a9e7c5. {{(pid=87802) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:04:42 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume volume-c22bdc55-5351-4e39-9644-597e5ca93951 (c22bdc55-5351-4e39-9644-597e5ca93951): created successfully Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3bf690-897e-4486-922a-be452a22ca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (a3b4b413-d60c-4a4c-88ed-dd8e71206f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b7074a08-21b1-4198-ae4e-b69aa453e527 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created volume successfully. Sep 05 21:04:42 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd 1073741824" returned: 0 in 0.644s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:42 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd Sep 05 21:04:42 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:43 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd" returned: 0 in 0.345s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-9249082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4843a709-ff3a-41a4-a816-e3a47f74ff5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:41Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Creating volume 4843a709-ff3a-41a4-a816-e3a47f74ff5b {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:43 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb30a09c-a56e-4793-8762-6c00139b130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11640889-4bfb-4827-856b-c554a09baefd', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314ee7eb-e87b-4652-af4b-e66d561a0323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:43 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b 1073741824 Sep 05 21:04:43 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:43 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume volume-11640889-4bfb-4827-856b-c554a09baefd (11640889-4bfb-4827-856b-c554a09baefd): created successfully Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314ee7eb-e87b-4652-af4b-e66d561a0323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (0a937382-b160-481c-9d37-994a62329b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-912ce13a-9fb8-4451-9465-7e48c4e81f40 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created volume successfully. Sep 05 21:04:44 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b 1073741824" returned: 0 in 0.897s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:44 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b Sep 05 21:04:44 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:44 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b" returned: 0 in 0.275s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.822s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2052524604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d758dd-13f6-4c4a-beec-816f282b5ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfb4cc085a847bf88bf9b3322f46594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:41Z,use_quota=True,user_id='f565796255274ed5b2f3c317da54dc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Creating volume 04d758dd-13f6-4c4a-beec-816f282b5ac6 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:44 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157a1b53-dd06-4e92-91b1-5e6249f00b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e54ce6f-757c-419d-a44c-781e4261a184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:44 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 1073741824 Sep 05 21:04:44 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:44 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b (4843a709-ff3a-41a4-a816-e3a47f74ff5b): created successfully Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e54ce6f-757c-419d-a44c-781e4261a184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (9531f9ab-5de7-4f76-8452-d836e01aec70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:44 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-4a86ecd5-9e1a-4620-a6e8-34d91eb446f6 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created volume successfully. Sep 05 21:04:45 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 1073741824" returned: 0 in 0.596s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:45 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 Sep 05 21:04:45 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:45 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6" returned: 0 in 0.302s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fd4d63-199c-422a-9cfa-17f2fad1b56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d758dd-13f6-4c4a-beec-816f282b5ac6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba655097-032a-4f0e-8a17-d5b00dbae5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:45 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Volume volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 (04d758dd-13f6-4c4a-beec-816f282b5ac6): created successfully Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba655097-032a-4f0e-8a17-d5b00dbae5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Flow 'volume_create_manager' (340c2ce3-5a06-4d56-8218-5d70fc2699c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bab3e280-5f1e-4efc-8599-46c7d74da616 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created volume successfully. Sep 05 21:04:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-04d758dd-13f6-4c4a-beec-816f282b5ac6-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-04d758dd-13f6-4c4a-beec-816f282b5ac6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-quobyte-04d758dd-13f6-4c4a-beec-816f282b5ac6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-04d758dd-13f6-4c4a-beec-816f282b5ac6" acquired by "delete_volume" :: waited 0.040s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e775a-e3e0-418c-aa65-d1fc982862cf]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:46 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 Sep 05 21:04:46 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:46 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:46 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6 Sep 05 21:04:46 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:47 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-04d758dd-13f6-4c4a-beec-816f282b5ac6" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-04d758dd-13f6-4c4a-beec-816f282b5ac6" released by "delete_volume" :: held 0.762s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created reservations ['8f3507c7-ce8b-4db8-9ac3-2eace054dc51', 'a9d18f92-9b3c-4665-9113-4a1dd36ce8ce', '940353e1-2671-4a64-852c-8d672f5b1d05', '577edd10-4480-424f-abf5-2d0db52ec9e1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:47 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:47 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-4843a709-ff3a-41a4-a816-e3a47f74ff5b-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-4843a709-ff3a-41a4-a816-e3a47f74ff5b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-quobyte-4843a709-ff3a-41a4-a816-e3a47f74ff5b" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-4843a709-ff3a-41a4-a816-e3a47f74ff5b" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6a7e4c-48bc-49e4-be69-b6db02aac005]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:47 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.417s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Deleted volume successfully. Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d800d39e-e970-4ad1-bb90-744245ed4132 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-04d758dd-13f6-4c4a-beec-816f282b5ac6-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:47 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b Sep 05 21:04:47 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "cinder-abf786e9-8fcb-417b-a885-3e104d40b6c5-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "cinder-abf786e9-8fcb-417b-a885-3e104d40b6c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "cinder-quobyte-abf786e9-8fcb-417b-a885-3e104d40b6c5" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "cinder-quobyte-abf786e9-8fcb-417b-a885-3e104d40b6c5" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b28eebd-1f9b-4a78-aeb9-7427aa1ed4f4]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:47 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 Sep 05 21:04:47 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:48 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b" returned: 0 in 0.440s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:48 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b Sep 05 21:04:48 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:48 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5" returned: 0 in 0.377s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:48 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5 Sep 05 21:04:48 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:48 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4843a709-ff3a-41a4-a816-e3a47f74ff5b" returned: 0 in 0.282s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-4843a709-ff3a-41a4-a816-e3a47f74ff5b" released by "delete_volume" :: held 0.767s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created reservations ['bc4e81a4-6558-4716-b4f1-ee52162fa165', '2b65aebf-4227-4380-a349-99cb95a76bbb', '0f323902-325b-46f7-893a-8b80e5c94737', '293e769e-3464-40fc-96d7-c097658b4026'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:48 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:48 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:48 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-abf786e9-8fcb-417b-a885-3e104d40b6c5" returned: 0 in 0.277s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "cinder-quobyte-abf786e9-8fcb-417b-a885-3e104d40b6c5" released by "delete_volume" :: held 0.710s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Created reservations ['99c81190-f4e6-4689-95e6-861162eadd45', 'd120aad4-37e8-416b-8c27-ce71525d5c38', '0a622c4b-3ca5-4b58-9816-0c0e4b10bf3d', '1ec4295a-71e0-4c82-afd8-d6fe16ad3494'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-11640889-4bfb-4827-856b-c554a09baefd-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-11640889-4bfb-4827-856b-c554a09baefd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-quobyte-11640889-4bfb-4827-856b-c554a09baefd" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-11640889-4bfb-4827-856b-c554a09baefd" acquired by "delete_volume" :: waited 0.042s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:48 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:48 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c04fbc-d447-44e4-ab37-246bb70859dc]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:48 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.340s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Deleted volume successfully. Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-619b20c4-0036-4d36-bdb7-da10b062e8d4 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-4843a709-ff3a-41a4-a816-e3a47f74ff5b-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:48 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd Sep 05 21:04:48 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "cinder-354b8394-453c-4d69-a929-ef7672f08a62-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "cinder-354b8394-453c-4d69-a929-ef7672f08a62-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:49 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "cinder-quobyte-354b8394-453c-4d69-a929-ef7672f08a62" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Deleted volume successfully. Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "cinder-quobyte-354b8394-453c-4d69-a929-ef7672f08a62" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8daf1b3a-f770-4de8-b8c1-7dcf1f2706f8 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "cinder-abf786e9-8fcb-417b-a885-3e104d40b6c5-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95dfe23-f0d4-4f81-8132-2c657907d88a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:49 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 Sep 05 21:04:49 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:49 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd" returned: 0 in 0.480s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:49 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd Sep 05 21:04:49 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:49 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62" returned: 0 in 0.373s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:49 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62 Sep 05 21:04:49 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:49 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-11640889-4bfb-4827-856b-c554a09baefd" returned: 0 in 0.274s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-11640889-4bfb-4827-856b-c554a09baefd" released by "delete_volume" :: held 0.806s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created reservations ['c38fc61e-5f1b-4376-8213-18a607c656c5', '898e1eca-4c38-49e9-882e-a5ee8c4b3b3a', '05e97059-f695-4d99-80ca-b5ce7f15d202', '3b8d5863-386a-4ef7-bf1b-2692037e0226'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:49 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:49 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:49 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-354b8394-453c-4d69-a929-ef7672f08a62" returned: 0 in 0.299s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "cinder-quobyte-354b8394-453c-4d69-a929-ef7672f08a62" released by "delete_volume" :: held 0.725s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-c22bdc55-5351-4e39-9644-597e5ca93951-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-c22bdc55-5351-4e39-9644-597e5ca93951-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-quobyte-c22bdc55-5351-4e39-9644-597e5ca93951" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Created reservations ['a1644908-a271-48ae-8cd7-5f9648d81cc2', 'a1f4e0b6-7e28-4e23-9915-378052004e06', '7527499c-e441-4345-9b56-7e908234b7e1', '4ffd901c-6847-4ac6-b917-e176b64b4320'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:49 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-c22bdc55-5351-4e39-9644-597e5ca93951" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da92b97-bc01-4c9a-ab21-4f7a35cc0d2b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Deleted volume successfully. Sep 05 21:04:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-29764075-6f7c-4599-9719-fc0bb5a9dc69 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-11640889-4bfb-4827-856b-c554a09baefd-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:50 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:50 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:50 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 Sep 05 21:04:50 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:50 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.278s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Deleted volume successfully. Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2df32023-9927-439e-84f3-8e8cb4636607 tempest-TestServerVolumeAttachmentScenario-1777905331 None] Lock "cinder-354b8394-453c-4d69-a929-ef7672f08a62-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:50 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951" returned: 0 in 0.484s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:50 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951 Sep 05 21:04:50 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:50 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c22bdc55-5351-4e39-9644-597e5ca93951" returned: 0 in 0.277s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-c22bdc55-5351-4e39-9644-597e5ca93951" released by "delete_volume" :: held 0.811s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created reservations ['c96a2c99-4b60-4cc3-9910-d67e35dedbae', 'd67decb4-504f-46d5-83af-9d238cc38f3d', '1cd5427d-83ad-4500-98b1-306c7a03eba0', '6ade6713-19a9-4bdf-9d07-e98104179674'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:51 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:51 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-25be8dc7-c9da-4412-a641-85e6d2c5aea1-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-25be8dc7-c9da-4412-a641-85e6d2c5aea1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-quobyte-25be8dc7-c9da-4412-a641-85e6d2c5aea1" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-25be8dc7-c9da-4412-a641-85e6d2c5aea1" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cba314-e6b3-4ea0-bdd8-6e5165335cd3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:51 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 Sep 05 21:04:51 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:51 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.400s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Deleted volume successfully. Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-505af8d0-4898-474d-8937-6e0323869bd5 tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-c22bdc55-5351-4e39-9644-597e5ca93951-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:51 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1" returned: 0 in 0.392s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:51 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1 Sep 05 21:04:51 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:51 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-25be8dc7-c9da-4412-a641-85e6d2c5aea1" returned: 0 in 0.316s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-25be8dc7-c9da-4412-a641-85e6d2c5aea1" released by "delete_volume" :: held 0.762s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created reservations ['7fde0fb2-9a9b-401d-a1ee-a948fc400e34', 'f4b58888-666f-4eae-b2c2-3882acb02beb', '0515054c-03f5-4f66-ab44-39f7ed46d393', '1cf0a161-2294-4bd3-9f2d-dabb757682b1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:52 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:52 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-6a7842d8-ef79-4f45-98a0-5c7b8953900f-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-6a7842d8-ef79-4f45-98a0-5c7b8953900f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-quobyte-f2afd43e-0f39-478c-a399-2d2087796779" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-f2afd43e-0f39-478c-a399-2d2087796779" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-quobyte-6a7842d8-ef79-4f45-98a0-5c7b8953900f" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-6a7842d8-ef79-4f45-98a0-5c7b8953900f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Deleting offline snapshot 6a7842d8-ef79-4f45-98a0-5c7b8953900f of volume f2afd43e-0f39-478c-a399-2d2087796779 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] snapshot_file for this snap is: volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:04:52 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.349s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Deleted volume successfully. Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[25468b85-73c4-42af-b5b4-6a6ff3b49045]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-814b91b9-8377-4db1-b168-7507f871e00b tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-25be8dc7-c9da-4412-a641-85e6d2c5aea1-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:52 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f Sep 05 21:04:52 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:52 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f" returned: 0 in 0.452s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2afd43e-0f39-478c-a399-2d2087796779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51b9f20-e993-4ba1-ab84-7ba2c6163406]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:53 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 Sep 05 21:04:53 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:53 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779" returned: 0 in 0.447s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:53 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f Sep 05 21:04:53 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Flow 'volume_create_manager' (a6d845b1-4ee7-4c30-a7c7-efbac890a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f45af8-57c9-4c75-a35a-042afa37e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f45af8-57c9-4c75-a35a-042afa37e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e987dd-720b-49c5-ae4e-770939d4082f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c77a0384e0405398edb80c7815333c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:54Z,use_quota=True,user_id='6626dbc71b424f37bcab6ed641184af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57820bcf-af8e-437d-bf5c-9cec04b9f825),volume_type_id=57820bcf-af8e-437d-bf5c-9cec04b9f825)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a10e02c-4977-4025-9444-74f1c5716316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a10e02c-4977-4025-9444-74f1c5716316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a825c9a6-f6ed-4a06-932e-6ce96d44b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:04:53 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f" returned: 0 in 0.367s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:53 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f Sep 05 21:04:53 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a825c9a6-f6ed-4a06-932e-6ce96d44b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99e987dd-720b-49c5-ae4e-770939d4082f', 'volume_name': 'volume-99e987dd-720b-49c5-ae4e-770939d4082f', 'volume_size': 1, 'image_id': '0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e1e8df744ddd9914588d0aaafe286b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58c77a0384e0405398edb80c7815333c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be2bb97b92657e1fbca7927d744bb5d10b9748b5850f905e77945c65bf11969d23dd419af59160f5529d3c358c362aee42600dd96ddc35f637b34b2117514a8e', 'id': '0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'created_at': datetime.datetime(2026, 9, 5, 19, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d4fcbb-d76b-4cbe-a3a4-e9e04e578ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d4fcbb-d76b-4cbe-a3a4-e9e04e578ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af81a259-09e3-4ccf-b638-9986f9e9b191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Volume 99e987dd-720b-49c5-ae4e-770939d4082f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99e987dd-720b-49c5-ae4e-770939d4082f', 'volume_size': 1, 'image_id': '0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e1e8df744ddd9914588d0aaafe286b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58c77a0384e0405398edb80c7815333c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be2bb97b92657e1fbca7927d744bb5d10b9748b5850f905e77945c65bf11969d23dd419af59160f5529d3c358c362aee42600dd96ddc35f637b34b2117514a8e', 'id': '0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'created_at': datetime.datetime(2026, 9, 5, 19, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Trying to clone 99e987dd-720b-49c5-ae4e-770939d4082f from image 0a4eeb8e-f2cb-4054-91b6-403e36fa67a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:04:54 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779.6a7842d8-ef79-4f45-98a0-5c7b8953900f" returned: 0 in 0.270s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-6a7842d8-ef79-4f45-98a0-5c7b8953900f" released by "_delete_snapshot" :: held 1.740s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-f2afd43e-0f39-478c-a399-2d2087796779" released by "delete_snapshot" :: held 1.777s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:04:54 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Image download 0.00 MB at 0.00 MB/s Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created reservations ['4dc54c32-59e8-4bec-b8c2-b0e53bf1a23f', 'e46b2044-e4de-4ff5-919e-922e8cdaa73a', '7fbf8930-ad22-4d44-b9d7-d5acdabb6891', '72fa6e32-2b29-429b-8644-1cc7f2d0cddc'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d521279d-7230-43bd-93e4-50f3be927216]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:54 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Delete snapshot completed successfully. Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ad9932bb-0115-4c4f-b7d6-ed0e6209dc5c tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-6a7842d8-ef79-4f45-98a0-5c7b8953900f-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:54 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD Sep 05 21:04:54 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-f2afd43e-0f39-478c-a399-2d2087796779-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-f2afd43e-0f39-478c-a399-2d2087796779-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "cinder-quobyte-f2afd43e-0f39-478c-a399-2d2087796779" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-f2afd43e-0f39-478c-a399-2d2087796779" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc46b0-7d54-47b1-a1e8-da04361f122c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:54 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:54 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 Sep 05 21:04:54 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:54 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD Sep 05 21:04:54 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:55 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Temporary image 0a4eeb8e-f2cb-4054-91b6-403e36fa67a2 is fetched for user 6626dbc71b424f37bcab6ed641184af3. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:04:55 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779" returned: 0 in 0.464s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:55 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779 Sep 05 21:04:55 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc10bfe-b550-4004-8a27-5ff56bf59a3b]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:55 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD Sep 05 21:04:55 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:55 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-f2afd43e-0f39-478c-a399-2d2087796779" returned: 0 in 0.286s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-quobyte-f2afd43e-0f39-478c-a399-2d2087796779" released by "delete_volume" :: held 0.839s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Created reservations ['e4362387-0ebf-4918-b41e-321b5c4ca92e', 'ece145da-1d7c-4e50-bf7d-288bf4125bd9', '8a1bc0f1-a98f-434c-8344-7938a490cdcf', 'd4488962-b269-4ce2-bed9-87d16a62ec2f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:55 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:55 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:55 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:55 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD Sep 05 21:04:55 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:55 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:04:55 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:55 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.291s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Deleted volume successfully. Sep 05 21:04:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a6f8e5dd-88fc-4787-8cfc-8149db69d3cc tempest-CreateVolumesFromSnapshotTest-1102832392 None] Lock "cinder-f2afd43e-0f39-478c-a399-2d2087796779-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:56 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD" returned: 1 in 0.476s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e987dd-720b-49c5-ae4e-770939d4082f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c77a0384e0405398edb80c7815333c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:54Z,use_quota=True,user_id='6626dbc71b424f37bcab6ed641184af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57820bcf-af8e-437d-bf5c-9cec04b9f825),volume_type_id=57820bcf-af8e-437d-bf5c-9cec04b9f825)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Creating volume 99e987dd-720b-49c5-ae4e-770939d4082f {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:56 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:56 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.396s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:04:56 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f 1073741824 Sep 05 21:04:56 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:04:56 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f 1073741824" returned: 0 in 0.493s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:56 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f Sep 05 21:04:56 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:56 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f" returned: 0 in 0.302s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:56 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Attempting download of 0a4eeb8e-f2cb-4054-91b6-403e36fa67a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'metadata': {}}])) to volume 99e987dd-720b-49c5-ae4e-770939d4082f. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:04:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e533f3-b2e3-4267-ade6-075162a05689]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_khotqqmz {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:57 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_khotqqmz Sep 05 21:04:57 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:57 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_khotqqmz" returned: 0 in 0.366s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_khotqqmz {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:57 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_khotqqmz Sep 05 21:04:57 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:57 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_khotqqmz" returned: 1 in 0.396s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_khotqqmz' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:04:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cc7918-1f3b-49f1-99b2-f0bb74c78fc9]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:57 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD Sep 05 21:04:57 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:58 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:58 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD Sep 05 21:04:58 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:58 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:04:58 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] 0a4eeb8e-f2cb-4054-91b6-403e36fa67a2 was raw, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:04:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:58 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f Sep 05 21:04:58 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:59 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f" returned: 0 in 0.516s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a4eeb8e-f2cb-4054-91b6-403e36fa67a2_g0875hd5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:04:59 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:59 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f 1G Sep 05 21:04:59 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (4988f46a-e46a-47d8-b062-110e34126dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba2a71b-7f72-4cc9-95fe-ef6eebd9a948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba2a71b-7f72-4cc9-95fe-ef6eebd9a948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1058996432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cfeefc7-698d-4d3a-b743-7ec82e9d5901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:59Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957da260-fb9d-4f91-b7f8-7b0516024f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957da260-fb9d-4f91-b7f8-7b0516024f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0687d115-33c9-40f1-9bd5-8712a08f5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0687d115-33c9-40f1-9bd5-8712a08f5295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cfeefc7-698d-4d3a-b743-7ec82e9d5901', 'volume_name': 'volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997b8faf-67b0-4230-8e73-57e3eb8f1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997b8faf-67b0-4230-8e73-57e3eb8f1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd16ebb-459f-4f5e-b935-a90970318a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume 9cfeefc7-698d-4d3a-b743-7ec82e9d5901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901', 'volume_size': 1} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1058996432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cfeefc7-698d-4d3a-b743-7ec82e9d5901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:59Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Creating volume 9cfeefc7-698d-4d3a-b743-7ec82e9d5901 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:04:59 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:59 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 1073741824 Sep 05 21:04:59 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:59 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f 1G" returned: 0 in 0.395s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Downloaded image 0a4eeb8e-f2cb-4054-91b6-403e36fa67a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'metadata': {}}])) to volume 99e987dd-720b-49c5-ae4e-770939d4082f successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Temporary image 0a4eeb8e-f2cb-4054-91b6-403e36fa67a2 for user 6626dbc71b424f37bcab6ed641184af3 is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Marking volume 99e987dd-720b-49c5-ae4e-770939d4082f as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Copying metadata from image 0a4eeb8e-f2cb-4054-91b6-403e36fa67a2 to 99e987dd-720b-49c5-ae4e-770939d4082f. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Creating volume glance metadata for volume 99e987dd-720b-49c5-ae4e-770939d4082f backed by image 0a4eeb8e-f2cb-4054-91b6-403e36fa67a2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f1e1e8df744ddd9914588d0aaafe286b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af81a259-09e3-4ccf-b638-9986f9e9b191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e987dd-720b-49c5-ae4e-770939d4082f', 'volume_size': 1, 'image_id': '0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e1e8df744ddd9914588d0aaafe286b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58c77a0384e0405398edb80c7815333c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be2bb97b92657e1fbca7927d744bb5d10b9748b5850f905e77945c65bf11969d23dd419af59160f5529d3c358c362aee42600dd96ddc35f637b34b2117514a8e', 'id': '0a4eeb8e-f2cb-4054-91b6-403e36fa67a2', 'created_at': datetime.datetime(2026, 9, 5, 19, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a4eeb8e-f2cb-4054-91b6-403e36fa67a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecb76b6-8a50-4adc-9530-574a4674dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Volume volume-99e987dd-720b-49c5-ae4e-770939d4082f (99e987dd-720b-49c5-ae4e-770939d4082f): created successfully Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecb76b6-8a50-4adc-9530-574a4674dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Flow 'volume_create_manager' (a6d845b1-4ee7-4c30-a7c7-efbac890a154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-28497d6a-f24f-4344-9a42-70da582fc7ac tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Created volume successfully. Sep 05 21:04:59 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 1073741824" returned: 0 in 0.452s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:59 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 Sep 05 21:04:59 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:00 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901" returned: 0 in 0.262s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd16ebb-459f-4f5e-b935-a90970318a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61c0aeb-dc1b-4fde-aa15-0e5f738cc5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:00 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 (9cfeefc7-698d-4d3a-b743-7ec82e9d5901): created successfully Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61c0aeb-dc1b-4fde-aa15-0e5f738cc5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (4988f46a-e46a-47d8-b062-110e34126dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-90f0b5eb-0f45-4d28-bffe-cdc13c257694 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created volume successfully. Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Acquiring lock "cinder-99e987dd-720b-49c5-ae4e-770939d4082f-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "cinder-99e987dd-720b-49c5-ae4e-770939d4082f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Acquiring lock "cinder-quobyte-99e987dd-720b-49c5-ae4e-770939d4082f" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "cinder-quobyte-99e987dd-720b-49c5-ae4e-770939d4082f" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570f2cd-566d-493f-bcbe-d9b4e1a45016]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:00 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f Sep 05 21:05:00 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:00 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f" returned: 0 in 0.364s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:00 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f Sep 05 21:05:00 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:00 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-99e987dd-720b-49c5-ae4e-770939d4082f" returned: 0 in 0.265s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "cinder-quobyte-99e987dd-720b-49c5-ae4e-770939d4082f" released by "delete_volume" :: held 0.671s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:00 devstack cinder-volume[87802]: WARNING cinder.quota [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:05:00 devstack cinder-volume[87802]: WARNING cinder.quota [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Created reservations ['1508e448-c248-4752-860b-a90ae576632c', '719d7626-4ef9-4b1e-b38c-9fcaf88aa41a', '4c1deb20-6165-417a-b014-4707afec35b4', '0e5a5cb5-7298-44cc-bf91-7f5b6996f1fc'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:01 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:01 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:01 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.307s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:01 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Deleted volume successfully. Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-783e59a0-e1ad-49a5-a66c-70cb63c18107 tempest-VolumeAndVolumeTypeFromImageTest-741924836 None] Lock "cinder-99e987dd-720b-49c5-ae4e-770939d4082f-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:01 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (e30e1749-47b9-4909-9678-8269acc715a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8605096-bbfe-4648-b5b4-dae54bc556c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8605096-bbfe-4648-b5b4-dae54bc556c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-457813488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240fcf09-a57a-4417-b71a-e5458916d893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:02Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53eebe36-3c32-4d6e-a22d-38ab4a076b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53eebe36-3c32-4d6e-a22d-38ab4a076b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359c2751-9c7f-4430-b9f0-be7234664ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359c2751-9c7f-4430-b9f0-be7234664ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240fcf09-a57a-4417-b71a-e5458916d893', 'volume_name': 'volume-240fcf09-a57a-4417-b71a-e5458916d893', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d439f650-3a69-4834-8ffc-334bb05955e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d439f650-3a69-4834-8ffc-334bb05955e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a53b67-cffe-4754-ba8a-4f0a1626ed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume 240fcf09-a57a-4417-b71a-e5458916d893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240fcf09-a57a-4417-b71a-e5458916d893', 'volume_size': 1} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-457813488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240fcf09-a57a-4417-b71a-e5458916d893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:02Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Creating volume 240fcf09-a57a-4417-b71a-e5458916d893 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:02 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:02 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 1073741824 Sep 05 21:05:02 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (d9ff995a-e85a-4507-b0e4-524e71ebc047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f067b940-4c5b-4239-a6bf-d124cad16866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f067b940-4c5b-4239-a6bf-d124cad16866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1467781448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2742569-6e05-43dc-9e34-a72fb3ce34b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:02Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7037e592-2b8c-497c-9f05-5349d52bed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7037e592-2b8c-497c-9f05-5349d52bed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bdfa3a4-382b-4d8a-a2c2-ab8bf8138e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bdfa3a4-382b-4d8a-a2c2-ab8bf8138e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2742569-6e05-43dc-9e34-a72fb3ce34b9', 'volume_name': 'volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dce163e-4804-4866-a3aa-36b9fd4e8be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dce163e-4804-4866-a3aa-36b9fd4e8be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750ee715-8f61-4e89-b9c4-2de2ac6823ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:02 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume e2742569-6e05-43dc-9e34-a72fb3ce34b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9', 'volume_size': 1} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:02 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 1073741824" returned: 0 in 0.606s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:02 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 Sep 05 21:05:02 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:03 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893" returned: 0 in 0.382s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1467781448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2742569-6e05-43dc-9e34-a72fb3ce34b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:02Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Creating volume e2742569-6e05-43dc-9e34-a72fb3ce34b9 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:03 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a53b67-cffe-4754-ba8a-4f0a1626ed46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240fcf09-a57a-4417-b71a-e5458916d893', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ad5fcc-14c6-4038-81a0-ea080f32eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 1073741824 Sep 05 21:05:03 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:03 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume volume-240fcf09-a57a-4417-b71a-e5458916d893 (240fcf09-a57a-4417-b71a-e5458916d893): created successfully Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ad5fcc-14c6-4038-81a0-ea080f32eecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (e30e1749-47b9-4909-9678-8269acc715a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-56ab262d-14d0-4763-a11b-ae671b591e72 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created volume successfully. Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (73c73bf2-64f2-4337-8ff0-122614e0ed96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae1aae1-b484-46a0-abd8-33f3f545fe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae1aae1-b484-46a0-abd8-33f3f545fe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1838260462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6cc67c-a5dd-4475-9a13-ab9080682ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:03Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8ae319-a7a7-4a80-9990-65344ebdd181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8ae319-a7a7-4a80-9990-65344ebdd181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff3cb1a-1723-427b-9808-d3db4d40007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff3cb1a-1723-427b-9808-d3db4d40007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6cc67c-a5dd-4475-9a13-ab9080682ddb', 'volume_name': 'volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07d50fb-239c-4580-96f2-c6b9495487e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07d50fb-239c-4580-96f2-c6b9495487e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edceafa-2bf1-4898-8c85-693aa613bf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume dd6cc67c-a5dd-4475-9a13-ab9080682ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb', 'volume_size': 1} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (17153ebe-558e-4d54-b4fd-6c99e13e60e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eff9a9e-7d62-493f-a64d-7635d055d56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eff9a9e-7d62-493f-a64d-7635d055d56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-80775642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85fc220-98d1-4339-b5d4-a8c52f7e780b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:04Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c211aa1-2e71-4704-a284-098862e68e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c211aa1-2e71-4704-a284-098862e68e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4791691b-1e51-47eb-a9ea-84632f5aaf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4791691b-1e51-47eb-a9ea-84632f5aaf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85fc220-98d1-4339-b5d4-a8c52f7e780b', 'volume_name': 'volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463e55e8-cae1-4234-9515-520cf00e3e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463e55e8-cae1-4234-9515-520cf00e3e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d54f2b-9649-4715-8fb1-65ac7bbbfa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:03 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume a85fc220-98d1-4339-b5d4-a8c52f7e780b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b', 'volume_size': 1} Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:03 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 1073741824" returned: 0 in 0.756s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:04 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 Sep 05 21:05:04 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:04 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9" returned: 0 in 0.321s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1838260462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6cc67c-a5dd-4475-9a13-ab9080682ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:03Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Creating volume dd6cc67c-a5dd-4475-9a13-ab9080682ddb {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:04 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:04 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb 1073741824 Sep 05 21:05:04 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750ee715-8f61-4e89-b9c4-2de2ac6823ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d03cfb3-006e-4dd4-ad05-f9c4c2334bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 (e2742569-6e05-43dc-9e34-a72fb3ce34b9): created successfully Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d03cfb3-006e-4dd4-ad05-f9c4c2334bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (d9ff995a-e85a-4507-b0e4-524e71ebc047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (f3c6d65c-9a5e-440e-a97f-d7ea6d478ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c38ded8-1285-4dd6-af80-7a5e6b2ba02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ecf966d2-cfae-4070-9b60-5431f28561e2 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created volume successfully. Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c38ded8-1285-4dd6-af80-7a5e6b2ba02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91734828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bc037d-ddbe-4436-b9fe-36c9c74b5e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:04Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec33bda3-f685-4e8e-9b97-b4aaf8547ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec33bda3-f685-4e8e-9b97-b4aaf8547ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5193fd0-6dcb-475e-b00d-1fc615ea9570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5193fd0-6dcb-475e-b00d-1fc615ea9570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bc037d-ddbe-4436-b9fe-36c9c74b5e04', 'volume_name': 'volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667c6479-d72d-4e43-9f1a-8267184f17c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667c6479-d72d-4e43-9f1a-8267184f17c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618baf34-2489-43b7-b4bd-55be3a24087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume 80bc037d-ddbe-4436-b9fe-36c9c74b5e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04', 'volume_size': 1} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Flow 'volume_create_manager' (dedbf38d-9544-488c-8e0c-7f8e5793994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a06d40-5143-45af-ac60-7cfc546ddc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a06d40-5143-45af-ac60-7cfc546ddc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46d5ce5-5c09-41e7-8a61-74b0fd50c03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8273e2d840c342738cfea5a70ae31e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:05Z,use_quota=True,user_id='da2ec284db1747a99a2b9acb4da7118f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308e9f90-afaa-4009-b585-299b1ad04b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308e9f90-afaa-4009-b585-299b1ad04b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d3ebe6-cfef-42e6-a597-72a31f86579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d3ebe6-cfef-42e6-a597-72a31f86579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46d5ce5-5c09-41e7-8a61-74b0fd50c03a', 'volume_name': 'volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec88b171-45b1-4347-b95f-ca94177a88e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec88b171-45b1-4347-b95f-ca94177a88e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655dc480-59c7-464c-9a36-da0f24a47291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:04 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Volume a46d5ce5-5c09-41e7-8a61-74b0fd50c03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a', 'volume_size': 1} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:04 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb 1073741824" returned: 0 in 0.584s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:05 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb Sep 05 21:05:05 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:05 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb" returned: 0 in 0.275s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-80775642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85fc220-98d1-4339-b5d4-a8c52f7e780b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:04Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Creating volume a85fc220-98d1-4339-b5d4-a8c52f7e780b {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:05 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edceafa-2bf1-4898-8c85-693aa613bf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e88e9b-f10b-4c71-be4e-c3cdad2bf3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:05 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b 1073741824 Sep 05 21:05:05 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:05 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb (dd6cc67c-a5dd-4475-9a13-ab9080682ddb): created successfully Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e88e9b-f10b-4c71-be4e-c3cdad2bf3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (73c73bf2-64f2-4337-8ff0-122614e0ed96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-af28ce98-e1b3-4456-be92-2c2f09f19440 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created volume successfully. Sep 05 21:05:05 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b 1073741824" returned: 0 in 0.492s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:05 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b Sep 05 21:05:05 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:06 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91734828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bc037d-ddbe-4436-b9fe-36c9c74b5e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f0cb6e1554ab9815ed4c650d33427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:04Z,use_quota=True,user_id='3be74fc49f0b45a1a2909b85316b2407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Creating volume 80bc037d-ddbe-4436-b9fe-36c9c74b5e04 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:06 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d54f2b-9649-4715-8fb1-65ac7bbbfa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:06 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 1073741824 Sep 05 21:05:06 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44d9290-b571-49a7-98ea-554d7d7e4859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:06 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b (a85fc220-98d1-4339-b5d4-a8c52f7e780b): created successfully Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44d9290-b571-49a7-98ea-554d7d7e4859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (17153ebe-558e-4d54-b4fd-6c99e13e60e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:06 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-4fa07236-3e48-4478-88ab-31b859c832bf tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created volume successfully. Sep 05 21:05:06 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 1073741824" returned: 0 in 0.419s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:06 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 Sep 05 21:05:06 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:06 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04" returned: 0 in 0.255s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46d5ce5-5c09-41e7-8a61-74b0fd50c03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8273e2d840c342738cfea5a70ae31e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:05Z,use_quota=True,user_id='da2ec284db1747a99a2b9acb4da7118f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Creating volume a46d5ce5-5c09-41e7-8a61-74b0fd50c03a {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:06 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618baf34-2489-43b7-b4bd-55be3a24087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:06 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a 1073741824 Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0ddc95-caa2-4dec-8cde-fd580d1e0e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:06 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:06 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Volume volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 (80bc037d-ddbe-4436-b9fe-36c9c74b5e04): created successfully Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0ddc95-caa2-4dec-8cde-fd580d1e0e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:06 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Flow 'volume_create_manager' (f3c6d65c-9a5e-440e-a97f-d7ea6d478ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:06 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c2998d2e-ee17-40a6-a3f1-66cf1f08e22c tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created volume successfully. Sep 05 21:05:07 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a 1073741824" returned: 0 in 0.411s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=137,cinder:UPDATE=167,cinder:DELETE=12,cinder:INSERT=42 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=128,cinder:UPDATE=154,cinder:INSERT=40,cinder:DELETE=16 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:07 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a Sep 05 21:05:07 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:07 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a" returned: 0 in 0.228s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655dc480-59c7-464c-9a36-da0f24a47291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba01da6b-093f-4bc6-a81d-9fe8e50cea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:07 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Volume volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a (a46d5ce5-5c09-41e7-8a61-74b0fd50c03a): created successfully Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba01da6b-093f-4bc6-a81d-9fe8e50cea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Flow 'volume_create_manager' (dedbf38d-9544-488c-8e0c-7f8e5793994e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:07 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-313f0f2c-574f-46c3-96f5-b672e0cf7e2f tempest-CinderUnicodeTest-192142092 None] Created volume successfully. Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-80bc037d-ddbe-4436-b9fe-36c9c74b5e04-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-80bc037d-ddbe-4436-b9fe-36c9c74b5e04-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-quobyte-80bc037d-ddbe-4436-b9fe-36c9c74b5e04" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-80bc037d-ddbe-4436-b9fe-36c9c74b5e04" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[063d320e-bd14-4ed3-92b4-ccae570a9131]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:07 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 Sep 05 21:05:07 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:08 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04" returned: 0 in 0.377s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:08 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04 Sep 05 21:05:08 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Flow 'volume_create_manager' (de626c92-ddbc-4d5f-8293-bf8c797e8b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000c854f-bf5c-4ff2-b474-0ded70f5ddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000c854f-bf5c-4ff2-b474-0ded70f5ddc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1756135079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a5cf55-ba18-425d-9d1b-ecee13b8371a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8273e2d840c342738cfea5a70ae31e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:08Z,use_quota=True,user_id='da2ec284db1747a99a2b9acb4da7118f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705c0ca0-706b-4a94-9d70-aa4de9dba8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705c0ca0-706b-4a94-9d70-aa4de9dba8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9e33e9-70c2-43b0-a4b6-a49e7611a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9e33e9-70c2-43b0-a4b6-a49e7611a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a5cf55-ba18-425d-9d1b-ecee13b8371a', 'volume_name': 'volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3362fa-c4ac-4037-939b-01f44f1332fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3362fa-c4ac-4037-939b-01f44f1332fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:08 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9b1189-b763-4363-9a6b-dbad27ead683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:08 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Volume c0a5cf55-ba18-425d-9d1b-ecee13b8371a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a', 'volume_size': 1} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1756135079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a5cf55-ba18-425d-9d1b-ecee13b8371a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8273e2d840c342738cfea5a70ae31e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:08Z,use_quota=True,user_id='da2ec284db1747a99a2b9acb4da7118f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Creating volume c0a5cf55-ba18-425d-9d1b-ecee13b8371a {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:08 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-80bc037d-ddbe-4436-b9fe-36c9c74b5e04" returned: 0 in 0.277s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:08 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a 1073741824 Sep 05 21:05:08 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-80bc037d-ddbe-4436-b9fe-36c9c74b5e04" released by "delete_volume" :: held 0.695s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created reservations ['10518665-19f4-4b32-b1ba-962e8dca1893', '158b2eb7-4aa9-4346-a0c4-e7c0e8c8bd81', 'c23afbc5-015c-4159-bb8b-f89ff0094f90', 'dc78b456-5baf-4d35-8cbd-894a1cc612d2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:08 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:08 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:08 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.256s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:08 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Deleted volume successfully. Sep 05 21:05:08 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a 1073741824" returned: 0 in 0.427s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c1f10514-1ae1-46b9-8e6b-797184b25b13 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-80bc037d-ddbe-4436-b9fe-36c9c74b5e04-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-a85fc220-98d1-4339-b5d4-a8c52f7e780b-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-a85fc220-98d1-4339-b5d4-a8c52f7e780b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-quobyte-a85fc220-98d1-4339-b5d4-a8c52f7e780b" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:09 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a Sep 05 21:05:09 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-a85fc220-98d1-4339-b5d4-a8c52f7e780b" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed4bae-96dd-46f7-80ef-ba8bc959588f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:09 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b Sep 05 21:05:09 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:09 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" returned: 0 in 0.257s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9b1189-b763-4363-9a6b-dbad27ead683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5aca4b-08d9-4901-aa74-1d9d6b306ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:09 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Volume volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a (c0a5cf55-ba18-425d-9d1b-ecee13b8371a): created successfully Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5aca4b-08d9-4901-aa74-1d9d6b306ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Flow 'volume_create_manager' (de626c92-ddbc-4d5f-8293-bf8c797e8b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:09 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ef6430eb-ab72-42ae-8d99-3c6d4c54fa87 tempest-CinderUnicodeTest-192142092 None] Created volume successfully. Sep 05 21:05:09 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b" returned: 0 in 0.366s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:09 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b Sep 05 21:05:09 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:09 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a85fc220-98d1-4339-b5d4-a8c52f7e780b" returned: 0 in 0.264s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Creating offline snapshot 15b716b9-301c-4f42-a176-3bc0e4aa083f of volume c0a5cf55-ba18-425d-9d1b-ecee13b8371a {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-a85fc220-98d1-4339-b5d4-a8c52f7e780b" released by "delete_volume" :: held 0.677s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911befc-228a-4a1c-bc0b-a4cc1184539b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created reservations ['b307707e-d86a-4518-9d80-5671ed40f338', 'e349d5a7-c3a8-4eda-8a6f-46373900e8c4', '863c8144-270c-45b5-9bca-e52db2a1b55f', '4b25e2e1-13e4-435d-8903-189a5a76cdb7'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:09 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:09 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:09 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:09 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.270s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Deleted volume successfully. Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-dd6cc67c-a5dd-4475-9a13-ab9080682ddb-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:10 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f 1G Sep 05 21:05:10 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-33db7de3-deda-4f10-b443-6c2d23e6e370 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-a85fc220-98d1-4339-b5d4-a8c52f7e780b-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-dd6cc67c-a5dd-4475-9a13-ab9080682ddb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-quobyte-dd6cc67c-a5dd-4475-9a13-ab9080682ddb" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-dd6cc67c-a5dd-4475-9a13-ab9080682ddb" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2024507-93d5-47bb-b2b3-7b735a99e834]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb Sep 05 21:05:10 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f 1G" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f Sep 05 21:05:10 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb" returned: 0 in 0.370s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb Sep 05 21:05:10 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f" returned: 0 in 0.285s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f is being set with open permissions: ugo+rw Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f Sep 05 21:05:10 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dd6cc67c-a5dd-4475-9a13-ab9080682ddb" returned: 0 in 0.260s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-dd6cc67c-a5dd-4475-9a13-ab9080682ddb" released by "delete_volume" :: held 0.667s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:10 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created reservations ['7bf48789-a36d-4405-ba2a-6dd7874affd0', '93b63cb5-0982-4139-9fae-ebdb8e991305', '1172253a-8f5b-415a-9da9-a130ef00d586', '588954e5-6961-4e63-bf58-981bcfbc9965'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:11 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f" returned: 0 in 0.274s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.info Sep 05 21:05:11 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.256s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:11 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Deleted volume successfully. Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-10d51858-9712-45f1-83cf-dbcff083efc0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-dd6cc67c-a5dd-4475-9a13-ab9080682ddb-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-e2742569-6e05-43dc-9e34-a72fb3ce34b9-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-e2742569-6e05-43dc-9e34-a72fb3ce34b9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:11 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-quobyte-e2742569-6e05-43dc-9e34-a72fb3ce34b9" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.info" returned: 0 in 0.281s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:11 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.info is being set with open permissions: ugo+rw Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-e2742569-6e05-43dc-9e34-a72fb3ce34b9" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:11 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.info Sep 05 21:05:11 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e33f648-86fc-4204-b957-abeeed69823d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 Sep 05 21:05:11 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.info" returned: 0 in 0.248s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:11 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c4c27343-914a-47bb-9f22-d7ce0636cba3 tempest-CinderUnicodeTest-192142092 None] Create snapshot completed successfully Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "cinder-15b716b9-301c-4f42-a176-3bc0e4aa083f-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:11 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9" returned: 0 in 0.378s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-15b716b9-301c-4f42-a176-3bc0e4aa083f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "cinder-quobyte-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:11 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9 Sep 05 21:05:11 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-quobyte-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "cinder-quobyte-15b716b9-301c-4f42-a176-3bc0e4aa083f" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-quobyte-15b716b9-301c-4f42-a176-3bc0e4aa083f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Deleting offline snapshot 15b716b9-301c-4f42-a176-3bc0e4aa083f of volume c0a5cf55-ba18-425d-9d1b-ecee13b8371a {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] snapshot_file for this snap is: volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b509a6ae-0b7c-42c7-8dfd-7d809bacde42]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f Sep 05 21:05:12 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:12 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2742569-6e05-43dc-9e34-a72fb3ce34b9" returned: 0 in 0.240s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-e2742569-6e05-43dc-9e34-a72fb3ce34b9" released by "delete_volume" :: held 0.660s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created reservations ['3a263ccc-bed7-4049-a044-aad3e7bd1a1f', '11ceee10-99be-48c4-a433-eec759c007ee', 'a6b029dc-8a4a-4b76-aa71-7c57d4fd5ad4', '7e56f0a5-2f06-4327-9eb6-9130b4d39aa8'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:12 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:12 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f" returned: 0 in 0.398s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8687eb-2523-45ba-9451-d41b5dd8a38f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a Sep 05 21:05:12 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:12 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.258s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:12 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Deleted volume successfully. Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-240fcf09-a57a-4417-b71a-e5458916d893-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdea1e20-231d-4e13-9de5-5359a8a308d8 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-e2742569-6e05-43dc-9e34-a72fb3ce34b9-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-240fcf09-a57a-4417-b71a-e5458916d893-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-quobyte-240fcf09-a57a-4417-b71a-e5458916d893" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-240fcf09-a57a-4417-b71a-e5458916d893" acquired by "delete_volume" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[38124e61-819b-4c49-b4ca-8bcb35751bf8]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 Sep 05 21:05:12 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:12 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" returned: 0 in 0.377s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f Sep 05 21:05:12 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:13 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893" returned: 0 in 0.372s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:13 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893 Sep 05 21:05:13 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:13 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f" returned: 0 in 0.351s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:13 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f Sep 05 21:05:13 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:13 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-240fcf09-a57a-4417-b71a-e5458916d893" returned: 0 in 0.253s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-240fcf09-a57a-4417-b71a-e5458916d893" released by "delete_volume" :: held 0.663s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created reservations ['f05a025e-6895-46da-9114-45f7650f84c6', 'eed82226-4a2d-4cb6-9961-8b9eff83c668', '9f9f73de-0587-4e26-a211-466b7f9418b5', '2744a9c6-1c59-4e04-a7fc-6ce82f4ccb4f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:13 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a.15b716b9-301c-4f42-a176-3bc0e4aa083f" returned: 0 in 0.263s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-quobyte-15b716b9-301c-4f42-a176-3bc0e4aa083f" released by "_delete_snapshot" :: held 1.505s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-quobyte-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" released by "delete_snapshot" :: held 1.551s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:13 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:13 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Created reservations ['8a7e0e13-32f0-482d-8849-04c81227108c', 'c267ed2b-2bde-4c36-b693-cedc9b88d209', '47e6cabc-c53e-4aec-a473-29bd05ecb85d', '60374235-6692-4935-87d1-39b3c2e62789'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:13 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Delete snapshot completed successfully. Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35509ce2-69f5-4f3e-a1ba-22863c05a878 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-15b716b9-301c-4f42-a176-3bc0e4aa083f-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:13 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-9cfeefc7-698d-4d3a-b743-7ec82e9d5901-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.266s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:13 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Deleted volume successfully. Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-9cfeefc7-698d-4d3a-b743-7ec82e9d5901-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-590510f0-95f1-4786-85ee-a7438eb746ce tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-240fcf09-a57a-4417-b71a-e5458916d893-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "cinder-quobyte-9cfeefc7-698d-4d3a-b743-7ec82e9d5901" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-9cfeefc7-698d-4d3a-b743-7ec82e9d5901" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeae71f-59ed-4736-8b04-0aadc0b1237d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:13 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 Sep 05 21:05:13 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Acquiring lock "cinder-c0a5cf55-ba18-425d-9d1b-ecee13b8371a-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Lock "cinder-c0a5cf55-ba18-425d-9d1b-ecee13b8371a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Acquiring lock "cinder-quobyte-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Lock "cinder-quobyte-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" acquired by "delete_volume" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b14adc-48cd-4c9f-a154-2a75b365a6f0]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:14 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901" returned: 0 in 0.382s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:14 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901 Sep 05 21:05:14 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:14 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a Sep 05 21:05:14 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:14 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-9cfeefc7-698d-4d3a-b743-7ec82e9d5901" returned: 0 in 0.246s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-quobyte-9cfeefc7-698d-4d3a-b743-7ec82e9d5901" released by "delete_volume" :: held 0.669s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:14 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" returned: 0 in 0.357s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:14 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a Sep 05 21:05:14 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Created reservations ['95b4eeee-2d2e-43dc-84cd-bba97992d21c', '34ce53df-bf89-45db-ba93-6106ce97d0a7', '5f3c6ff5-9d8c-4784-a8b1-c8588472b6ed', 'b26d5051-fd83-45be-9195-b6cd3b73b308'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:14 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:14 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:14 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" returned: 0 in 0.257s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Lock "cinder-quobyte-c0a5cf55-ba18-425d-9d1b-ecee13b8371a" released by "delete_volume" :: held 0.672s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Created reservations ['7b8d9944-0353-4787-83d4-cec445993827', '53c87698-edd2-477b-9d34-fede29111edb', '9c464eb2-9f6e-416d-913b-a9f8c72915a6', 'd7f0dac9-612d-4b5e-b7ab-6c3cb7176df5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:14 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.252s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:14 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Deleted volume successfully. Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9f32fb40-d15a-440b-9a8e-34488cbf01e0 tempest-CreateVolumesFromSourceVolumeTest-1409285661 None] Lock "cinder-9cfeefc7-698d-4d3a-b743-7ec82e9d5901-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:14 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:14 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:15 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:15 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Deleted volume successfully. Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "cinder-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8377d899-6f57-407c-afc1-9afd196f991e tempest-CinderUnicodeTest-192142092 None] Lock "cinder-c0a5cf55-ba18-425d-9d1b-ecee13b8371a-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "cinder-quobyte-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-quobyte-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a" acquired by "delete_volume" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e158483-1168-468c-b345-d13c2108f3d6]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:15 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a Sep 05 21:05:15 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:15 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a" returned: 0 in 0.388s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:15 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a Sep 05 21:05:15 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:15 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a" returned: 0 in 0.250s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-quobyte-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a" released by "delete_volume" :: held 0.675s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:15 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Created reservations ['6fd07b22-d9df-4d4d-bd76-301d958d3fe3', '1c3853c8-b53b-4c7d-ac09-614fb1008af0', 'dd5176c8-9ee5-4c45-b633-494ab1d3edd2', '44abe97c-4d56-4d62-ae60-55f761ab8c95'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:16 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:16 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:16 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.265s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Deleted volume successfully. Sep 05 21:05:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c76bb1e4-c0bb-4c7a-9637-7a46c6182632 tempest-CinderUnicodeTest-192142092 None] Lock "cinder-a46d5ce5-5c09-41e7-8a61-74b0fd50c03a-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Flow 'volume_create_manager' (eb97fa83-c5cf-4936-9ba0-746678dbfbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eaf9dfd-1bc4-44e9-8522-031afca07256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eaf9dfd-1bc4-44e9-8522-031afca07256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1872308036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cae236-0c3b-4e19-96b2-1ebd075eacf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5a8762659940d0985451cef1ff92bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:19Z,use_quota=True,user_id='3b98868a4f3d42498399772571b215e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca43fea0-ceda-4520-9703-0494abcb6c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca43fea0-ceda-4520-9703-0494abcb6c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8d9649-31db-4138-833a-de0b0845ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8d9649-31db-4138-833a-de0b0845ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60cae236-0c3b-4e19-96b2-1ebd075eacf6', 'volume_name': 'volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02560ef-f134-4438-b550-9533ab0930e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02560ef-f134-4438-b550-9533ab0930e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c511d605-2fe8-43fc-a123-ddde6b5c417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:18 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Volume 60cae236-0c3b-4e19-96b2-1ebd075eacf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6', 'volume_size': 1} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1872308036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cae236-0c3b-4e19-96b2-1ebd075eacf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5a8762659940d0985451cef1ff92bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:19Z,use_quota=True,user_id='3b98868a4f3d42498399772571b215e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Creating volume 60cae236-0c3b-4e19-96b2-1ebd075eacf6 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:18 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:18 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 1073741824 Sep 05 21:05:18 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:19 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 1073741824" returned: 0 in 0.496s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:19 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 Sep 05 21:05:19 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:19 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6" returned: 0 in 0.259s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c511d605-2fe8-43fc-a123-ddde6b5c417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff2ebec-e12d-4a96-8518-f57fcbbc2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:19 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Volume volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 (60cae236-0c3b-4e19-96b2-1ebd075eacf6): created successfully Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff2ebec-e12d-4a96-8518-f57fcbbc2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Flow 'volume_create_manager' (eb97fa83-c5cf-4936-9ba0-746678dbfbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-336859ff-0349-4f4b-91d0-8640c54ebdce tempest-ProjectReaderTests-1460288328 None] Created volume successfully. Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Acquiring lock "cinder-60cae236-0c3b-4e19-96b2-1ebd075eacf6-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Lock "cinder-60cae236-0c3b-4e19-96b2-1ebd075eacf6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Acquiring lock "cinder-quobyte-60cae236-0c3b-4e19-96b2-1ebd075eacf6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Lock "cinder-quobyte-60cae236-0c3b-4e19-96b2-1ebd075eacf6" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e4d07a-8fec-4366-b6ea-70f4d1293601]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:21 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 Sep 05 21:05:21 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:21 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6" returned: 0 in 0.430s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:21 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6 Sep 05 21:05:21 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:21 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-60cae236-0c3b-4e19-96b2-1ebd075eacf6" returned: 0 in 0.282s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Lock "cinder-quobyte-60cae236-0c3b-4e19-96b2-1ebd075eacf6" released by "delete_volume" :: held 0.764s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Created reservations ['3034a4f7-e1f8-46e6-bb89-d5fa4e1280b9', 'e3f7b472-9107-4c5c-9787-b1dd9e58ea78', 'd6c7b554-2c82-4f6d-ad31-eeb997849e21', '30e15bd7-9187-4f3d-8133-35112883db8c'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:22 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:22 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:22 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.280s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:22 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Deleted volume successfully. Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-699615a0-5f01-4931-b2cd-1eeed860d702 tempest-ProjectReaderTests-1460288328 None] Lock "cinder-60cae236-0c3b-4e19-96b2-1ebd075eacf6-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Flow 'volume_create_manager' (2c38f349-0eea-4e9f-84b3-71a4f0c0210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00111321-3e1d-43c6-a89f-37f6fbf8d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00111321-3e1d-43c6-a89f-37f6fbf8d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707694718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc4a297-b9d4-4fd3-b187-b285df0cd04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5a8762659940d0985451cef1ff92bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:23Z,use_quota=True,user_id='3b98868a4f3d42498399772571b215e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0c45af-19bb-4fc4-804b-e28607df12b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0c45af-19bb-4fc4-804b-e28607df12b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cdd168-6a51-4080-9de7-6d6231a3c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cdd168-6a51-4080-9de7-6d6231a3c584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc4a297-b9d4-4fd3-b187-b285df0cd04e', 'volume_name': 'volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f1abcd-1a11-4385-a47e-d6b4fb8ede8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f1abcd-1a11-4385-a47e-d6b4fb8ede8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8ca794-7c4e-48c8-982b-10ff2053c7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:22 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Volume dfc4a297-b9d4-4fd3-b187-b285df0cd04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e', 'volume_size': 1} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707694718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc4a297-b9d4-4fd3-b187-b285df0cd04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5a8762659940d0985451cef1ff92bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:23Z,use_quota=True,user_id='3b98868a4f3d42498399772571b215e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Creating volume dfc4a297-b9d4-4fd3-b187-b285df0cd04e {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:22 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:22 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e 1073741824 Sep 05 21:05:22 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:23 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e 1073741824" returned: 0 in 0.467s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:23 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e Sep 05 21:05:23 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:23 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e" returned: 0 in 0.256s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8ca794-7c4e-48c8-982b-10ff2053c7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933c16c2-00d9-4e33-b5b2-6eaea26c3135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Volume volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e (dfc4a297-b9d4-4fd3-b187-b285df0cd04e): created successfully Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933c16c2-00d9-4e33-b5b2-6eaea26c3135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Flow 'volume_create_manager' (2c38f349-0eea-4e9f-84b3-71a4f0c0210f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ce803a0d-a796-4e5c-9103-38a46aab16b4 tempest-ProjectReaderTests-1460288328 None] Created volume successfully. Sep 05 21:05:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Acquiring lock "cinder-dfc4a297-b9d4-4fd3-b187-b285df0cd04e-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Lock "cinder-dfc4a297-b9d4-4fd3-b187-b285df0cd04e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Acquiring lock "cinder-quobyte-dfc4a297-b9d4-4fd3-b187-b285df0cd04e" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Lock "cinder-quobyte-dfc4a297-b9d4-4fd3-b187-b285df0cd04e" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf768d4-c406-441f-801e-daa82ee2fcbc]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:25 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e Sep 05 21:05:25 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:25 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e" returned: 0 in 0.408s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:25 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e Sep 05 21:05:25 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:25 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfc4a297-b9d4-4fd3-b187-b285df0cd04e" returned: 0 in 0.255s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Lock "cinder-quobyte-dfc4a297-b9d4-4fd3-b187-b285df0cd04e" released by "delete_volume" :: held 0.707s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Created reservations ['a0642c0d-fa8c-46ff-bd58-1d6ebfe92784', '4fb51550-5b83-443e-b4f3-3d84df07917e', 'd18402c4-58a8-4d21-ac2a-d6e9569e19c5', 'c896b32b-b96b-46fd-85c0-6867fa8ce9d2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:25 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:25 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:26 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.265s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:26 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Deleted volume successfully. Sep 05 21:05:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-631c5659-0ab6-48f2-85c5-985a80a911d9 tempest-ProjectReaderTests-1460288328 None] Lock "cinder-dfc4a297-b9d4-4fd3-b187-b285df0cd04e-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:35 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=67,cinder:INSERT=27,cinder:UPDATE=96,cinder:DELETE=7 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:05:36 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=100,cinder:SELECT=64,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Flow 'volume_create_manager' (eee45b3a-743a-4089-b6e8-836e18a05b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b08160-d6ff-4dcf-a76d-161dec4ae6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b08160-d6ff-4dcf-a76d-161dec4ae6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1780868742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d801b24-a1e5-48d6-86be-79a6d999a273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2c983a2a7d481687b0af1ec5f071e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:48Z,use_quota=True,user_id='f83d36d414a642ce8bbd0bd551b5f68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88594d5-40a3-4f85-9314-176d6e400c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88594d5-40a3-4f85-9314-176d6e400c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a36adea-332b-4641-af06-00b4ed6d2d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a36adea-332b-4641-af06-00b4ed6d2d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d801b24-a1e5-48d6-86be-79a6d999a273', 'volume_name': 'volume-5d801b24-a1e5-48d6-86be-79a6d999a273', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2498d3a3-a2c2-4637-b7ae-792242806042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2498d3a3-a2c2-4637-b7ae-792242806042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f0c1e0-22d6-4fd8-8fb7-ebf637613f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Volume 5d801b24-a1e5-48d6-86be-79a6d999a273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d801b24-a1e5-48d6-86be-79a6d999a273', 'volume_size': 1} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1780868742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d801b24-a1e5-48d6-86be-79a6d999a273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2c983a2a7d481687b0af1ec5f071e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:48Z,use_quota=True,user_id='f83d36d414a642ce8bbd0bd551b5f68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Creating volume 5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:48 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:48 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 1073741824 Sep 05 21:05:48 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:48 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 1073741824" returned: 0 in 0.403s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:48 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 Sep 05 21:05:48 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:48 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273" returned: 0 in 0.244s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f0c1e0-22d6-4fd8-8fb7-ebf637613f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d801b24-a1e5-48d6-86be-79a6d999a273', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401c9d85-d69e-4d35-8ebd-5ffd2fa13c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Volume volume-5d801b24-a1e5-48d6-86be-79a6d999a273 (5d801b24-a1e5-48d6-86be-79a6d999a273): created successfully Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401c9d85-d69e-4d35-8ebd-5ffd2fa13c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Flow 'volume_create_manager' (eee45b3a-743a-4089-b6e8-836e18a05b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1ab8520a-4fe2-4a3c-ae99-3a5394b11f79 tempest-SnapshotDependencyTests-1569739516 None] Created volume successfully. Sep 05 21:05:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Creating offline snapshot 5104c175-c4b6-41fb-b5dc-1a592bdf3369 of volume 5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:05:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdff5ea2-64f7-40f5-8565-fe83ad310015]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:49 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 Sep 05 21:05:49 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:49 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273" returned: 0 in 0.347s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:49 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 1G Sep 05 21:05:49 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:50 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 1G" returned: 0 in 0.386s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d801b24-a1e5-48d6-86be-79a6d999a273 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:50 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d801b24-a1e5-48d6-86be-79a6d999a273 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 Sep 05 21:05:50 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:50 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d801b24-a1e5-48d6-86be-79a6d999a273 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369" returned: 0 in 0.280s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:50 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 is being set with open permissions: ugo+rw Sep 05 21:05:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:50 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 Sep 05 21:05:50 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:50 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369" returned: 0 in 0.233s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:50 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.info Sep 05 21:05:50 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:50 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.info" returned: 0 in 0.264s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:50 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.info is being set with open permissions: ugo+rw Sep 05 21:05:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:50 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.info Sep 05 21:05:50 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:51 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.info" returned: 0 in 0.232s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c758fa4d-4624-45a2-942f-0114b3b45764 tempest-SnapshotDependencyTests-1569739516 None] Create snapshot completed successfully Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Flow 'volume_create_manager' (8cc02b28-d6ae-4fc2-b142-81e50927da91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc820ba6-985b-46bc-b713-b0acd94a91b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc820ba6-985b-46bc-b713-b0acd94a91b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2c595d-a600-49c5-9771-900ee6b8475e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2c983a2a7d481687b0af1ec5f071e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5104c175-c4b6-41fb-b5dc-1a592bdf3369,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:52Z,use_quota=True,user_id='f83d36d414a642ce8bbd0bd551b5f68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5ff4d0-4445-4e28-aac1-8f932f749753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5ff4d0-4445-4e28-aac1-8f932f749753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6796953f-670c-4c74-b6b7-717e474dfdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6796953f-670c-4c74-b6b7-717e474dfdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c2c595d-a600-49c5-9771-900ee6b8475e', 'volume_name': 'volume-1c2c595d-a600-49c5-9771-900ee6b8475e', 'volume_size': 1, 'snapshot_id': '5104c175-c4b6-41fb-b5dc-1a592bdf3369'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a7a8a7-1a5d-4d19-a91c-4edb0396297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a7a8a7-1a5d-4d19-a91c-4edb0396297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c7ce26-a131-4475-8a71-cfa85243122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Volume 1c2c595d-a600-49c5-9771-900ee6b8475e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c2c595d-a600-49c5-9771-900ee6b8475e', 'volume_size': 1, 'snapshot_id': '5104c175-c4b6-41fb-b5dc-1a592bdf3369'} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-quobyte-5104c175-c4b6-41fb-b5dc-1a592bdf3369-1c2c595d-a600-49c5-9771-900ee6b8475e" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-5104c175-c4b6-41fb-b5dc-1a592bdf3369-1c2c595d-a600-49c5-9771-900ee6b8475e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Creating volume 1c2c595d-a600-49c5-9771-900ee6b8475e from snapshot 5104c175-c4b6-41fb-b5dc-1a592bdf3369 {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-quobyte-1c2c595d-a600-49c5-9771-900ee6b8475e" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-1c2c595d-a600-49c5-9771-900ee6b8475e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] snapshot: 5104c175-c4b6-41fb-b5dc-1a592bdf3369, volume: 1c2c595d-a600-49c5-9771-900ee6b8475e, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad3b38-df1e-44c7-b6cc-68a107d5123d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:52 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 Sep 05 21:05:52 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:52 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369" returned: 0 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d801b24-a1e5-48d6-86be-79a6d999a273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf83dc0-85c3-47b9-88bb-ecac799de365]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:52 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 Sep 05 21:05:52 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:52 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273" returned: 0 in 0.334s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:05:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:52 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e Sep 05 21:05:52 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:05:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:05:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:05:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:55 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:05:55 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:56 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.780s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:05:56 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e" returned: 0 in 3.845s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273, size 1024.00 MB, duration 3.85 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:05:56 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Converted 1024.00 MB image at 266.23 MB/s Sep 05 21:05:56 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e is being set with open permissions: ugo+rw Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:56 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e Sep 05 21:05:56 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:56 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e" returned: 0 in 0.233s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-1c2c595d-a600-49c5-9771-900ee6b8475e" released by "_copy_volume_from_snapshot" :: held 4.822s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-5104c175-c4b6-41fb-b5dc-1a592bdf3369-1c2c595d-a600-49c5-9771-900ee6b8475e" released by "_create_volume_from_snapshot" :: held 4.881s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.896s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c7ce26-a131-4475-8a71-cfa85243122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2c595d-a600-49c5-9771-900ee6b8475e', 'volume_size': 1, 'snapshot_id': '5104c175-c4b6-41fb-b5dc-1a592bdf3369'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00525975-b3c3-4c3e-bfbf-bae6d6da212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:56 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Volume volume-1c2c595d-a600-49c5-9771-900ee6b8475e (1c2c595d-a600-49c5-9771-900ee6b8475e): created successfully Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00525975-b3c3-4c3e-bfbf-bae6d6da212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Flow 'volume_create_manager' (8cc02b28-d6ae-4fc2-b142-81e50927da91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-35b8e44a-f3b8-4f40-ad9c-16d72fe8d93d tempest-SnapshotDependencyTests-1569739516 None] Created volume successfully. Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-5104c175-c4b6-41fb-b5dc-1a592bdf3369-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-5104c175-c4b6-41fb-b5dc-1a592bdf3369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-quobyte-5d801b24-a1e5-48d6-86be-79a6d999a273" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-5d801b24-a1e5-48d6-86be-79a6d999a273" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-quobyte-5104c175-c4b6-41fb-b5dc-1a592bdf3369" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-5104c175-c4b6-41fb-b5dc-1a592bdf3369" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Deleting offline snapshot 5104c175-c4b6-41fb-b5dc-1a592bdf3369 of volume 5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] snapshot_file for this snap is: volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cd8d47-78ab-4e9b-9daf-e220a79c253f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:57 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 Sep 05 21:05:57 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:57 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369" returned: 0 in 0.354s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d801b24-a1e5-48d6-86be-79a6d999a273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2536a876-f67c-47a9-b4b0-0da2ce9bbb4c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:58 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 Sep 05 21:05:58 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:58 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273" returned: 0 in 0.501s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:58 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 Sep 05 21:05:58 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:58 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:58 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369 Sep 05 21:05:58 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:58 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273.5104c175-c4b6-41fb-b5dc-1a592bdf3369" returned: 0 in 0.234s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-5104c175-c4b6-41fb-b5dc-1a592bdf3369" released by "_delete_snapshot" :: held 1.481s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-5d801b24-a1e5-48d6-86be-79a6d999a273" released by "delete_snapshot" :: held 1.501s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:59 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Created reservations ['c4ab17eb-54ce-413b-80e1-10110de4575f', 'd453428b-6ec4-4c8e-b283-91171ac439f0', '9fd3a05d-c74b-4fa9-a2e1-6a06a7d9958e', 'dfd6de99-78fb-4372-89f3-1c3f4d39dcb7'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Delete snapshot completed successfully. Sep 05 21:05:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d3ff8345-b2af-460f-a738-1ac9d64681b9 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-5104c175-c4b6-41fb-b5dc-1a592bdf3369-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-5d801b24-a1e5-48d6-86be-79a6d999a273-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-5d801b24-a1e5-48d6-86be-79a6d999a273-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-quobyte-5d801b24-a1e5-48d6-86be-79a6d999a273" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-5d801b24-a1e5-48d6-86be-79a6d999a273" acquired by "delete_volume" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:59 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413581e-2a08-41d3-bd0f-42a0adeec4dc]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:59 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 Sep 05 21:05:59 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:00 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273" returned: 0 in 0.376s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:00 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273 Sep 05 21:06:00 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:00 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5d801b24-a1e5-48d6-86be-79a6d999a273" returned: 0 in 0.235s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-5d801b24-a1e5-48d6-86be-79a6d999a273" released by "delete_volume" :: held 0.668s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Created reservations ['a6b4de41-cbe5-4efc-a681-da796fb8f257', 'e61d7c67-add6-4efb-9d8b-4e97293a4bd6', '3619bc9d-f94f-4d04-ac5c-abfa09de8ff2', '0d7d0648-a364-4800-aee0-200dd3465ac8'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:00 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:00 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:00 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.252s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Deleted volume successfully. Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e7f58c52-3278-4b20-80c9-fab52e28d8a2 tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-5d801b24-a1e5-48d6-86be-79a6d999a273-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-1c2c595d-a600-49c5-9771-900ee6b8475e-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-1c2c595d-a600-49c5-9771-900ee6b8475e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "cinder-quobyte-1c2c595d-a600-49c5-9771-900ee6b8475e" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-1c2c595d-a600-49c5-9771-900ee6b8475e" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e12fbd-1608-43f3-ae3c-b945e92bf6cb]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:00 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e Sep 05 21:06:00 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:01 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e" returned: 0 in 0.359s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:01 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e Sep 05 21:06:01 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:01 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-1c2c595d-a600-49c5-9771-900ee6b8475e" returned: 0 in 0.230s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-quobyte-1c2c595d-a600-49c5-9771-900ee6b8475e" released by "delete_volume" :: held 0.626s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Created reservations ['dedd5f52-4fdd-4046-95f5-c4b8c5e72260', '774ae906-ae6d-4820-9eab-cf11268020bf', '19c6f168-049c-4282-ac39-3e4e0aa40c7d', '4139e31a-dbd2-4dcc-97db-17aaed167962'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:01 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:01 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:01 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.234s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:01 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Deleted volume successfully. Sep 05 21:06:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e81237d1-8cab-4a27-b07b-98629559bf9c tempest-SnapshotDependencyTests-1569739516 None] Lock "cinder-1c2c595d-a600-49c5-9771-900ee6b8475e-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:11 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:06:11 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:06:22 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (350f489b-7171-4bfb-ae2a-75a963bbe21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6869695-9cf9-40d1-8f14-4c8aa4c8cac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6869695-9cf9-40d1-8f14-4c8aa4c8cac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1253430908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d020e2-e3a2-49ae-a0e0-c334a7811890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:23Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b981452f-8c39-42d7-81da-bafbfdf43081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b981452f-8c39-42d7-81da-bafbfdf43081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538abb2e-d411-46be-b216-6e9f76bbd4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:22 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538abb2e-d411-46be-b216-6e9f76bbd4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d020e2-e3a2-49ae-a0e0-c334a7811890', 'volume_name': 'volume-18d020e2-e3a2-49ae-a0e0-c334a7811890', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3d4acd-d56c-4c44-bce3-9a39b0d40424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3d4acd-d56c-4c44-bce3-9a39b0d40424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861fb7ff-eba2-447c-bedd-7a5c796e286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Volume 18d020e2-e3a2-49ae-a0e0-c334a7811890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d020e2-e3a2-49ae-a0e0-c334a7811890', 'volume_size': 1} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1253430908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d020e2-e3a2-49ae-a0e0-c334a7811890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:23Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Creating volume 18d020e2-e3a2-49ae-a0e0-c334a7811890 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:23 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:23 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 1073741824 Sep 05 21:06:23 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (4daae894-88ff-4f29-a3f1-586cb398adc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d54bed-09e0-4fc7-8cb7-615e58598537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d54bed-09e0-4fc7-8cb7-615e58598537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-504124446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5618ceab-8a73-4d76-9e1b-ba5b5586eef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:23Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c28bede-2097-4580-ae54-7c2d9158cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c28bede-2097-4580-ae54-7c2d9158cb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee861b35-f1c4-4e85-af84-e7380e863ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee861b35-f1c4-4e85-af84-e7380e863ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5618ceab-8a73-4d76-9e1b-ba5b5586eef1', 'volume_name': 'volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d558ee-d93a-4afe-a595-23f67ff08053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d558ee-d93a-4afe-a595-23f67ff08053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ca5e5e-1776-4de2-ba01-ceaab0fc972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume 5618ceab-8a73-4d76-9e1b-ba5b5586eef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1', 'volume_size': 1} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (ad60c375-56f7-4927-8aa6-724190833532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386da005-6c64-4872-af4f-8a10b687ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386da005-6c64-4872-af4f-8a10b687ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050703522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc9532e-1055-4c49-8f26-b3d9043c2d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:23Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b886f8d-b181-468b-8815-405babc9e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b886f8d-b181-468b-8815-405babc9e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c17567-25b7-4826-9c9c-e280f4fcdab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c17567-25b7-4826-9c9c-e280f4fcdab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc9532e-1055-4c49-8f26-b3d9043c2d4c', 'volume_name': 'volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b6c05f-33ce-452b-b00a-422d6721bb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b6c05f-33ce-452b-b00a-422d6721bb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa9e4df-924f-498d-8493-1cfe7165c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Volume bbc9532e-1055-4c49-8f26-b3d9043c2d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c', 'volume_size': 1} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Flow 'volume_create_manager' (ea4bb694-3943-4dba-bee6-df92fb3847d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb229961-ed5a-4c9e-97ed-9d4491e989aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb229961-ed5a-4c9e-97ed-9d4491e989aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1338316463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce1665c-34a3-4091-ab8f-f042a00a2e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd66aa5fa0dc416a945a95bde93b4549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:23Z,use_quota=True,user_id='895646b580b0413c87c2e50da4d153b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fd428f-412a-42a5-b4fa-af6c1bf19763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fd428f-412a-42a5-b4fa-af6c1bf19763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf7fc0b-70c9-45c4-a9c3-a1eb05d4b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf7fc0b-70c9-45c4-a9c3-a1eb05d4b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce1665c-34a3-4091-ab8f-f042a00a2e13', 'volume_name': 'volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7795c14-4c52-4b92-8ba5-ddfc4c7739e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7795c14-4c52-4b92-8ba5-ddfc4c7739e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bdff57-35eb-4de4-a76e-c01fea92d5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Volume 3ce1665c-34a3-4091-ab8f-f042a00a2e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13', 'volume_size': 1} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:23 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (fa1dc2c8-2e8a-4be7-bf10-98aca6043f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e5e768-d8a6-4083-94b2-bef6ffd790ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 1073741824" returned: 0 in 0.754s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e5e768-d8a6-4083-94b2-bef6ffd790ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-944642432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48246a31-3b5b-4a9d-9e92-0f2deb1a0014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:24Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c1692c-2fc2-4362-820a-3044b5f8ff7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c1692c-2fc2-4362-820a-3044b5f8ff7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d2b323-0891-4496-a5b9-3ef20e968052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d2b323-0891-4496-a5b9-3ef20e968052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48246a31-3b5b-4a9d-9e92-0f2deb1a0014', 'volume_name': 'volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e7ef36-f014-4cf6-9ba6-98cf672b399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e7ef36-f014-4cf6-9ba6-98cf672b399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365e4c90-fa19-48c1-af1a-11b688209b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Volume 48246a31-3b5b-4a9d-9e92-0f2deb1a0014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014', 'volume_size': 1} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:23 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 Sep 05 21:06:23 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:24 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (26618047-bda6-45e4-a531-6d0b45a8d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c421f0b-7b0d-4d72-8803-6f6f24a69b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890" returned: 0 in 0.326s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-504124446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5618ceab-8a73-4d76-9e1b-ba5b5586eef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:23Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Creating volume 5618ceab-8a73-4d76-9e1b-ba5b5586eef1 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:24 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c421f0b-7b0d-4d72-8803-6f6f24a69b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1839246172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210a1106-8e3c-4a20-9827-f3e4ab64dae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:24Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 1073741824 Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca89f9b-1d24-434e-87c5-3ea8e4c87c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca89f9b-1d24-434e-87c5-3ea8e4c87c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6575b065-caa4-4640-a1cb-a3f703ec3e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6575b065-caa4-4640-a1cb-a3f703ec3e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210a1106-8e3c-4a20-9827-f3e4ab64dae1', 'volume_name': 'volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7668dab-55cf-4539-8253-84ba871bb155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7668dab-55cf-4539-8253-84ba871bb155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c73173f-98b0-40c8-b7d5-14df45a3e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Volume 210a1106-8e3c-4a20-9827-f3e4ab64dae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1', 'volume_size': 1} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861fb7ff-eba2-447c-bedd-7a5c796e286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d020e2-e3a2-49ae-a0e0-c334a7811890', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c681911-d197-4cd7-b267-33e3923b237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Volume volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 (18d020e2-e3a2-49ae-a0e0-c334a7811890): created successfully Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c681911-d197-4cd7-b267-33e3923b237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (350f489b-7171-4bfb-ae2a-75a963bbe21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:24 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8a7b60ea-cdac-4e06-a027-9ddd65f1fd19 tempest-CreateVolumesFromImageTest-1261031270 None] Created volume successfully. Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (906dd335-359a-41fe-a290-5a4c48ca7d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28a7b1e-dfba-4968-9c70-c632f4050e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28a7b1e-dfba-4968-9c70-c632f4050e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1041194236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c586246d-3f63-4984-be88-8fbc32421d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:25Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398e9734-8fbf-4146-a9bd-27245a3e1289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398e9734-8fbf-4146-a9bd-27245a3e1289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0583691-05fd-40f3-83ac-2d278f37e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0583691-05fd-40f3-83ac-2d278f37e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c586246d-3f63-4984-be88-8fbc32421d83', 'volume_name': 'volume-c586246d-3f63-4984-be88-8fbc32421d83', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d89c38a-e48d-4102-ad8f-f2a0056e5f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d89c38a-e48d-4102-ad8f-f2a0056e5f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a1f1ea-6f6c-4c92-8ed7-212b521ddaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:24 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Volume c586246d-3f63-4984-be88-8fbc32421d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c586246d-3f63-4984-be88-8fbc32421d83', 'volume_size': 1} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:24 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 1073741824" returned: 0 in 0.531s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:24 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 Sep 05 21:06:24 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:25 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1" returned: 0 in 0.252s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050703522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc9532e-1055-4c49-8f26-b3d9043c2d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:23Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Creating volume bbc9532e-1055-4c49-8f26-b3d9043c2d4c {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:25 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:25 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c 1073741824 Sep 05 21:06:25 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ca5e5e-1776-4de2-ba01-ceaab0fc972f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1fb1f5-dbc7-4f6a-81c2-44ed7a8f11d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:25 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 (5618ceab-8a73-4d76-9e1b-ba5b5586eef1): created successfully Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1fb1f5-dbc7-4f6a-81c2-44ed7a8f11d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (4daae894-88ff-4f29-a3f1-586cb398adc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:25 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-091a549a-5363-46b8-8b74-b2d4f36ff2f6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created volume successfully. Sep 05 21:06:25 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c 1073741824" returned: 0 in 0.449s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:25 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c Sep 05 21:06:25 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:25 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c" returned: 0 in 0.266s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.162s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1338316463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce1665c-34a3-4091-ab8f-f042a00a2e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd66aa5fa0dc416a945a95bde93b4549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:23Z,use_quota=True,user_id='895646b580b0413c87c2e50da4d153b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Creating volume 3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:25 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa9e4df-924f-498d-8493-1cfe7165c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:25 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 1073741824 Sep 05 21:06:25 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974fa292-b402-44fe-bd06-a0ce85ab9431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:25 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Volume volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c (bbc9532e-1055-4c49-8f26-b3d9043c2d4c): created successfully Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974fa292-b402-44fe-bd06-a0ce85ab9431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:25 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (ad60c375-56f7-4927-8aa6-724190833532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:25 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6f12361e-5c28-4e52-8aee-9b5385cff463 tempest-CreateVolumesFromImageTest-1261031270 None] Created volume successfully. Sep 05 21:06:26 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 1073741824" returned: 0 in 0.472s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:26 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 Sep 05 21:06:26 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:26 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13" returned: 0 in 0.292s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.798s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-944642432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48246a31-3b5b-4a9d-9e92-0f2deb1a0014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:24Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Creating volume 48246a31-3b5b-4a9d-9e92-0f2deb1a0014 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:26 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bdff57-35eb-4de4-a76e-c01fea92d5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e931132e-6076-4cc7-bcfd-93638c6c5a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 1073741824 Sep 05 21:06:26 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:26 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Volume volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 (3ce1665c-34a3-4091-ab8f-f042a00a2e13): created successfully Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e931132e-6076-4cc7-bcfd-93638c6c5a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Flow 'volume_create_manager' (ea4bb694-3943-4dba-bee6-df92fb3847d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9cb8e4be-0b57-43a7-9bb0-101b0cbd3f28 tempest-VolumeDependencyTests-1243655810 None] Created volume successfully. Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (b3321c9c-d715-4cdf-b586-f15d79104bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342334e1-4fb3-408d-a595-06d5e3803e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342334e1-4fb3-408d-a595-06d5e3803e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1744667963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:27Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5aeea4-b40f-427f-9e53-6b321d84e0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5aeea4-b40f-427f-9e53-6b321d84e0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a5d273-25fa-4c11-96f9-f11c63fd2db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a5d273-25fa-4c11-96f9-f11c63fd2db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e', 'volume_name': 'volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed05421-010b-41a4-a2eb-e8e578c3693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed05421-010b-41a4-a2eb-e8e578c3693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02f0731-2283-41ef-bc84-f0b326cadd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume 2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e', 'volume_size': 1} Sep 05 21:06:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Flow 'volume_create_manager' (5a9279a1-5484-4fe2-9763-d816ae7c2548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:27 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb0b70d-20aa-48c6-8e6a-95b13d027b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 1073741824" returned: 0 in 0.699s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb0b70d-20aa-48c6-8e6a-95b13d027b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6948208a7084fb3925af68800be63a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:27Z,use_quota=True,user_id='10a08d64b03f4863987c1e9a2bb7bf2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a067d2b5-3c68-490d-bdc9-8ad1f65c0176),volume_type_id=a067d2b5-3c68-490d-bdc9-8ad1f65c0176)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b675f267-49ea-4144-ab94-209227ff5035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b675f267-49ea-4144-ab94-209227ff5035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89361d5c-ad80-43fe-86fb-e94586f4efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:27 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 Sep 05 21:06:27 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (a93aa9ae-40d4-4031-aebb-e0f12580d081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19d4281-1613-46f9-8526-cdd32d5e995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19d4281-1613-46f9-8526-cdd32d5e995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1233460950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f87cc31-24f8-4713-86ba-236022a0bf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:28Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282587c5-76ea-43a7-92b9-873459e98918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282587c5-76ea-43a7-92b9-873459e98918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d35b704-6efe-4160-9b5f-13ad9dc90dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d35b704-6efe-4160-9b5f-13ad9dc90dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f87cc31-24f8-4713-86ba-236022a0bf77', 'volume_name': 'volume-5f87cc31-24f8-4713-86ba-236022a0bf77', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc4020b-27db-4a9a-a9b1-8464c02a74bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc4020b-27db-4a9a-a9b1-8464c02a74bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031be936-9349-472c-bc4b-14b222143b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume 5f87cc31-24f8-4713-86ba-236022a0bf77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f87cc31-24f8-4713-86ba-236022a0bf77', 'volume_size': 1} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:27 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014" returned: 0 in 0.350s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1839246172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210a1106-8e3c-4a20-9827-f3e4ab64dae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:24Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Creating volume 210a1106-8e3c-4a20-9827-f3e4ab64dae1 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:27 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365e4c90-fa19-48c1-af1a-11b688209b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 1073741824 Sep 05 21:06:27 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9516da8a-2dde-4197-8e77-bbb28ca4cb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Volume volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 (48246a31-3b5b-4a9d-9e92-0f2deb1a0014): created successfully Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9516da8a-2dde-4197-8e77-bbb28ca4cb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (fa1dc2c8-2e8a-4be7-bf10-98aca6043f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (700cbab6-16d2-4bc5-b8f3-9a76483a3659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b583303d-4b57-48ed-ad31-5c54a1806eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89361d5c-ad80-43fe-86fb-e94586f4efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4', 'volume_name': 'volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4', 'volume_size': 1, 'image_id': 'f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b06c910166722a02c1b2cc759e028fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6948208a7084fb3925af68800be63a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d3aa07488846699fd4e2be3579f10a96fe8a61622a339ebd2a70480d7c95c6cf8de7374a3105b88dcde231d008e0571b6f400e63bd7057ae3a65cb822677fa1', 'id': 'f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8540813-ab94-4cf0-bddf-49da0bd87eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8540813-ab94-4cf0-bddf-49da0bd87eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632fc260-3887-4e7e-b5f2-cb305d0f3d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Volume c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4', 'volume_size': 1, 'image_id': 'f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b06c910166722a02c1b2cc759e028fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6948208a7084fb3925af68800be63a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d3aa07488846699fd4e2be3579f10a96fe8a61622a339ebd2a70480d7c95c6cf8de7374a3105b88dcde231d008e0571b6f400e63bd7057ae3a65cb822677fa1', 'id': 'f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Trying to clone c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 from image f1afd029-5785-4e1c-a756-2e0fb4e89dd2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b6135707-f453-44bd-96a8-ae4b9c38b70f tempest-CreateVolumesFromImageTest-1261031270 None] Created volume successfully. Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b583303d-4b57-48ed-ad31-5c54a1806eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392890495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c65404a-9d05-40a0-be0e-6313e7c396f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:28Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e34e940-c738-4317-9d0c-5a579802b741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e34e940-c738-4317-9d0c-5a579802b741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204c8362-7a99-4b1b-83aa-2d7194341fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204c8362-7a99-4b1b-83aa-2d7194341fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c65404a-9d05-40a0-be0e-6313e7c396f4', 'volume_name': 'volume-8c65404a-9d05-40a0-be0e-6313e7c396f4', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198e5005-8eff-45fb-bd0b-6b795d577bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198e5005-8eff-45fb-bd0b-6b795d577bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0e75e4-57a9-44e0-b9dc-c4aa7a7b00cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume 8c65404a-9d05-40a0-be0e-6313e7c396f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c65404a-9d05-40a0-be0e-6313e7c396f4', 'volume_size': 1} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Image download 0.00 MB at 0.00 MB/s Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[15504548-7b9d-4cbd-a97b-b90af654936a]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (adab9836-5829-4b0c-8c25-1b2837b4baac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad586a3-28a5-4d42-8bc3-ef4d3e686f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad586a3-28a5-4d42-8bc3-ef4d3e686f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687985011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d45291-e1e0-436d-aef7-4e858edba2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:28Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a59950f-2ab1-4bf2-a76b-a6264c55e217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a59950f-2ab1-4bf2-a76b-a6264c55e217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21f573-3b60-427c-9c31-071a38d7dd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21f573-3b60-427c-9c31-071a38d7dd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d45291-e1e0-436d-aef7-4e858edba2f4', 'volume_name': 'volume-37d45291-e1e0-436d-aef7-4e858edba2f4', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a3d363-4242-45b3-ad15-00a0feb19e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a3d363-4242-45b3-ad15-00a0feb19e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59274e3a-4ecd-4e35-b29f-e47df72e4c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume 37d45291-e1e0-436d-aef7-4e858edba2f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d45291-e1e0-436d-aef7-4e858edba2f4', 'volume_size': 1} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 1073741824" returned: 0 in 0.669s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:28 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD Sep 05 21:06:28 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:28 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 Sep 05 21:06:28 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:28 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (84e5bf5d-7c38-46dd-b05e-6d787730917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497548f2-ec52-4990-b5d6-80b59a57a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:28 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497548f2-ec52-4990-b5d6-80b59a57a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1818900356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa3e3da-9675-4656-a47c-4b149b3e0fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:29Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8d5e73-aded-499a-bf86-e456f2f5df7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8d5e73-aded-499a-bf86-e456f2f5df7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0a49b5-fdc5-4285-9fae-66d260baaa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0a49b5-fdc5-4285-9fae-66d260baaa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa3e3da-9675-4656-a47c-4b149b3e0fb5', 'volume_name': 'volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68458f3-2ee7-4f2f-a37f-d8ad68abe24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68458f3-2ee7-4f2f-a37f-d8ad68abe24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc30ba92-98af-4579-b34b-e80c75c721a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume dfa3e3da-9675-4656-a47c-4b149b3e0fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5', 'volume_size': 1} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1" returned: 0 in 0.341s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.130s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1041194236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c586246d-3f63-4984-be88-8fbc32421d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a829fe9784499830b88d5a3c63061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:25Z,use_quota=True,user_id='dedc95889590414f95f9182431e89054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Creating volume c586246d-3f63-4984-be88-8fbc32421d83 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c73173f-98b0-40c8-b7d5-14df45a3e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 1073741824 Sep 05 21:06:28 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd787096-578d-4e36-b66f-6329b0f5557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD Sep 05 21:06:28 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Volume volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 (210a1106-8e3c-4a20-9827-f3e4ab64dae1): created successfully Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd787096-578d-4e36-b66f-6329b0f5557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (26618047-bda6-45e4-a531-6d0b45a8d656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a7861488-15ec-4850-b211-f9f7e8dd2c86 tempest-CreateVolumesFromImageTest-1261031270 None] Created volume successfully. Sep 05 21:06:29 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Temporary image f1afd029-5785-4e1c-a756-2e0fb4e89dd2 is fetched for user 10a08d64b03f4863987c1e9a2bb7bf2e. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd7141-d678-4693-a21d-373210162914]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:29 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD Sep 05 21:06:29 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 1073741824" returned: 0 in 0.440s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:29 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 Sep 05 21:06:29 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:29 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83" returned: 0 in 0.251s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.618s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1744667963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:27Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Creating volume 2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:29 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:29 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD Sep 05 21:06:29 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e 1073741824 Sep 05 21:06:29 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a1f1ea-6f6c-4c92-8ed7-212b521ddaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c586246d-3f63-4984-be88-8fbc32421d83', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808cdd6e-51b2-4013-8415-b08ede686ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:29 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Volume volume-c586246d-3f63-4984-be88-8fbc32421d83 (c586246d-3f63-4984-be88-8fbc32421d83): created successfully Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808cdd6e-51b2-4013-8415-b08ede686ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Flow 'volume_create_manager' (906dd335-359a-41fe-a290-5a4c48ca7d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d86cd32a-2007-4907-bdd2-ae2f17bf461b tempest-CreateVolumesFromImageTest-1261031270 None] Created volume successfully. Sep 05 21:06:29 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-c586246d-3f63-4984-be88-8fbc32421d83-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-c586246d-3f63-4984-be88-8fbc32421d83-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-quobyte-c586246d-3f63-4984-be88-8fbc32421d83" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-c586246d-3f63-4984-be88-8fbc32421d83" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68e79ec-fb41-46ea-ac11-7c898d5a6ed3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:30 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e 1073741824" returned: 0 in 0.477s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:30 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 Sep 05 21:06:30 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:30 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e Sep 05 21:06:30 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:30 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e" returned: 0 in 0.249s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.770s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02f0731-2283-41ef-bc84-f0b326cadd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02c3288-f21b-4530-acbc-1830f90dc1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:30 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Creating offline snapshot e94551ff-e45a-4a2d-9168-218ae6192aa3 of volume 3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:30 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e (2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e): created successfully Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02c3288-f21b-4530-acbc-1830f90dc1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (b3321c9c-d715-4cdf-b586-f15d79104bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:30 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83 Sep 05 21:06:30 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0463f-e0b2-4cc7-ae13-82aa69032dc4]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-04918ce8-2175-4c56-94fb-cfb76479e581 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created volume successfully. Sep 05 21:06:30 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 Sep 05 21:06:30 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:30 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c586246d-3f63-4984-be88-8fbc32421d83" returned: 0 in 0.244s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-c586246d-3f63-4984-be88-8fbc32421d83" released by "delete_volume" :: held 0.689s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Created reservations ['233ab312-df83-464a-8eab-080b3063c05b', 'b0ac4d90-fe4b-4357-86cf-19d2c600dd2f', '837e295b-350f-47b0-9a49-9121457f1a05', 'cbd41459-3e04-47ba-93d2-be3024793cc8'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:30 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13" returned: 0 in 0.383s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:30 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:30 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:30 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 1G Sep 05 21:06:30 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:31 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.272s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:31 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Deleted volume successfully. Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-210a1106-8e3c-4a20-9827-f3e4ab64dae1-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-210a1106-8e3c-4a20-9827-f3e4ab64dae1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-26bc5fdd-6f39-4270-bdea-6adcd5cce403 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-c586246d-3f63-4984-be88-8fbc32421d83-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-quobyte-210a1106-8e3c-4a20-9827-f3e4ab64dae1" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-210a1106-8e3c-4a20-9827-f3e4ab64dae1" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f705d72f-a97c-4f3e-8e50-f7e073b1320a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:31 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 1G" returned: 0 in 0.469s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:31 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 Sep 05 21:06:31 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:31 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 Sep 05 21:06:31 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:31 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1" returned: 0 in 0.360s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:31 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1 Sep 05 21:06:31 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:31 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3" returned: 0 in 0.298s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:31 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 is being set with open permissions: ugo+rw Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:31 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 Sep 05 21:06:31 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:31 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-210a1106-8e3c-4a20-9827-f3e4ab64dae1" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-210a1106-8e3c-4a20-9827-f3e4ab64dae1" released by "delete_volume" :: held 0.663s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:31 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:31 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Created reservations ['dc295f9c-d02f-4b66-9162-49dc830127b5', '434c7809-89cf-41b1-b58d-38818670ac1a', '6aba7249-4d95-41cb-8e3b-d0c466134199', '43c01901-7be3-4fdd-9369-924f28657bd1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:31 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.info Sep 05 21:06:31 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:32 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:32 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:32 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.info" returned: 0 in 0.315s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:32 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.info is being set with open permissions: ugo+rw Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:32 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.info Sep 05 21:06:32 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:32 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-48246a31-3b5b-4a9d-9e92-0f2deb1a0014-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.284s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Deleted volume successfully. Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-48246a31-3b5b-4a9d-9e92-0f2deb1a0014-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-196fa3a7-808a-4d69-a01a-1fa21d293f02 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-210a1106-8e3c-4a20-9827-f3e4ab64dae1-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-quobyte-48246a31-3b5b-4a9d-9e92-0f2deb1a0014" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-48246a31-3b5b-4a9d-9e92-0f2deb1a0014" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f932aea9-51e0-4611-8be7-acc3762dedfd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:32 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 Sep 05 21:06:32 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:32 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.info" returned: 0 in 0.291s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.791s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1233460950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f87cc31-24f8-4713-86ba-236022a0bf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:28Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Creating volume 5f87cc31-24f8-4713-86ba-236022a0bf77 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:32 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:32 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 1073741824 Sep 05 21:06:32 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-86f916a4-bb03-4438-98b5-6aac03d19e20 tempest-VolumeDependencyTests-1243655810 None] Create snapshot completed successfully Sep 05 21:06:32 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014" returned: 0 in 0.387s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:32 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014 Sep 05 21:06:32 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:32 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 1073741824" returned: 0 in 0.421s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:33 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-48246a31-3b5b-4a9d-9e92-0f2deb1a0014" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:33 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 Sep 05 21:06:33 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-48246a31-3b5b-4a9d-9e92-0f2deb1a0014" released by "delete_volume" :: held 0.704s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Created reservations ['52edbfae-5905-42db-8dfe-a782008e5028', 'd2f50207-b8fe-40ff-9de4-58fca0e2f406', '2e91c332-214f-4508-9f26-bd9a066ed025', '4a285631-238a-44ab-9b51-6bacfe78be16'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:33 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:33 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:33 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77" returned: 0 in 0.287s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.212s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392890495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c65404a-9d05-40a0-be0e-6313e7c396f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:28Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Creating volume 8c65404a-9d05-40a0-be0e-6313e7c396f4 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:33 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:33 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 1073741824 Sep 05 21:06:33 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031be936-9349-472c-bc4b-14b222143b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f87cc31-24f8-4713-86ba-236022a0bf77', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a151ffb-ff66-4880-8638-13b749cb1b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume volume-5f87cc31-24f8-4713-86ba-236022a0bf77 (5f87cc31-24f8-4713-86ba-236022a0bf77): created successfully Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a151ffb-ff66-4880-8638-13b749cb1b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (a93aa9ae-40d4-4031-aebb-e0f12580d081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:33 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d12f7d54-c1ac-4d4a-81a3-0112365c2d4c tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created volume successfully. Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Flow 'volume_create_manager' (879a52c4-0396-403b-b8e4-6864494dc3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a61bac-a879-4f6d-84de-ab1fd2be4c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-bbc9532e-1055-4c49-8f26-b3d9043c2d4c-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a61bac-a879-4f6d-84de-ab1fd2be4c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1950122598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be8e7d2-e307-4681-81bf-d8d2bf0d895f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd66aa5fa0dc416a945a95bde93b4549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e94551ff-e45a-4a2d-9168-218ae6192aa3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:33Z,use_quota=True,user_id='895646b580b0413c87c2e50da4d153b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420c48bd-bd11-432f-ad11-7c50817b5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420c48bd-bd11-432f-ad11-7c50817b5f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f437ed4-a13e-40a7-ac95-aa21a474d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f437ed4-a13e-40a7-ac95-aa21a474d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2be8e7d2-e307-4681-81bf-d8d2bf0d895f', 'volume_name': 'volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f', 'volume_size': 1, 'snapshot_id': 'e94551ff-e45a-4a2d-9168-218ae6192aa3'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50245e45-87b8-4bbc-983a-ffb7a9597c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50245e45-87b8-4bbc-983a-ffb7a9597c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4ba6c2-a95a-4891-85c9-00fa090558b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Volume 2be8e7d2-e307-4681-81bf-d8d2bf0d895f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f', 'volume_size': 1, 'snapshot_id': 'e94551ff-e45a-4a2d-9168-218ae6192aa3'} Sep 05 21:06:33 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-bbc9532e-1055-4c49-8f26-b3d9043c2d4c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.387s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:33 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Deleted volume successfully. Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2411f374-9a90-4855-a314-42831246d581 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-48246a31-3b5b-4a9d-9e92-0f2deb1a0014-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-quobyte-bbc9532e-1055-4c49-8f26-b3d9043c2d4c" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-bbc9532e-1055-4c49-8f26-b3d9043c2d4c" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ccf493-ae1e-4f3d-a6ea-86889080c35e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:33 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 1073741824" returned: 0 in 0.509s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:33 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c Sep 05 21:06:33 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:33 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 Sep 05 21:06:33 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:34 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c" returned: 0 in 0.419s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:34 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4" returned: 0 in 0.290s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.719s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687985011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d45291-e1e0-436d-aef7-4e858edba2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:28Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Creating volume 37d45291-e1e0-436d-aef7-4e858edba2f4 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:34 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c Sep 05 21:06:34 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:34 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0e75e4-57a9-44e0-b9dc-c4aa7a7b00cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c65404a-9d05-40a0-be0e-6313e7c396f4', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417bfa16-2391-4bd2-895d-43d13c2e043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:34 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 1073741824 Sep 05 21:06:34 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:34 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 (8c65404a-9d05-40a0-be0e-6313e7c396f4): created successfully Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417bfa16-2391-4bd2-895d-43d13c2e043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (700cbab6-16d2-4bc5-b8f3-9a76483a3659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:34 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e3584b5b-9e1a-49a5-9a23-6eae43ed440b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created volume successfully. Sep 05 21:06:34 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-bbc9532e-1055-4c49-8f26-b3d9043c2d4c" returned: 0 in 0.295s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-bbc9532e-1055-4c49-8f26-b3d9043c2d4c" released by "delete_volume" :: held 0.765s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Created reservations ['375f913e-cde5-4e47-a5eb-0da31f7bec15', '9082edb7-d08d-4dca-9c1a-aaf80b77d62a', '033579b8-4e62-408b-b7e4-0d7d17e3c1da', 'a0f6a6f6-cf02-41bf-b916-578da0cf377f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:34 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:34 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:34 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 1073741824" returned: 0 in 0.506s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-18d020e2-e3a2-49ae-a0e0-c334a7811890-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-18d020e2-e3a2-49ae-a0e0-c334a7811890-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:34 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 Sep 05 21:06:34 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "cinder-quobyte-18d020e2-e3a2-49ae-a0e0-c334a7811890" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-18d020e2-e3a2-49ae-a0e0-c334a7811890" acquired by "delete_volume" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d516c0c-3734-4bc1-85bf-9d8d88a3a99f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:34 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.328s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:34 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Deleted volume successfully. Sep 05 21:06:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-9cade64b-ac01-4ff9-984e-720332ce23f8 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-bbc9532e-1055-4c49-8f26-b3d9043c2d4c-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:35 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 Sep 05 21:06:35 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:35 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4" returned: 0 in 0.299s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.206s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1818900356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa3e3da-9675-4656-a47c-4b149b3e0fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e77f9df7d74f6fafecdc7bada95f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:29Z,use_quota=True,user_id='7e4d4ddae8d9413388f28f2dcd13d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Creating volume dfa3e3da-9675-4656-a47c-4b149b3e0fb5 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:35 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59274e3a-4ecd-4e35-b29f-e47df72e4c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d45291-e1e0-436d-aef7-4e858edba2f4', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:35 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 1073741824 Sep 05 21:06:35 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed97f2-b6e8-4016-80c6-017d0edf9231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume volume-37d45291-e1e0-436d-aef7-4e858edba2f4 (37d45291-e1e0-436d-aef7-4e858edba2f4): created successfully Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed97f2-b6e8-4016-80c6-017d0edf9231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (adab9836-5829-4b0c-8c25-1b2837b4baac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-31d62a5f-2b56-4de7-82ab-3a1ee44df881 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created volume successfully. Sep 05 21:06:35 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890" returned: 0 in 0.444s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:35 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890 Sep 05 21:06:35 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:35 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 1073741824" returned: 0 in 0.512s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:35 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-18d020e2-e3a2-49ae-a0e0-c334a7811890" returned: 0 in 0.279s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-quobyte-18d020e2-e3a2-49ae-a0e0-c334a7811890" released by "delete_volume" :: held 0.778s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:35 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 Sep 05 21:06:35 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Created reservations ['bd665e67-c7bc-4ac3-a9ad-3e15f6d510c5', '7694f82c-7c34-463a-93a2-84c14c8148bf', 'ff1437ec-da3c-4264-9cbd-5258aa36c232', '5671956e-7a39-4250-98d6-2df3b18dc888'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:35 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:35 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:35 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5" returned: 0 in 0.259s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6948208a7084fb3925af68800be63a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:27Z,use_quota=True,user_id='10a08d64b03f4863987c1e9a2bb7bf2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a067d2b5-3c68-490d-bdc9-8ad1f65c0176),volume_type_id=a067d2b5-3c68-490d-bdc9-8ad1f65c0176)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Creating volume c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:35 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc30ba92-98af-4579-b34b-e80c75c721a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d4ff68-4541-414a-978e-b112a1fede91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:35 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 1073741824 Sep 05 21:06:35 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Volume volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 (dfa3e3da-9675-4656-a47c-4b149b3e0fb5): created successfully Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d4ff68-4541-414a-978e-b112a1fede91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Flow 'volume_create_manager' (84e5bf5d-7c38-46dd-b05e-6d787730917b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:36 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-884c9f35-9825-47e7-be5f-5b9ebd851012 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created volume successfully. Sep 05 21:06:36 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.318s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:36 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Deleted volume successfully. Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-133ff87c-cd61-4746-95e3-091a1dd14ea5 tempest-CreateVolumesFromImageTest-1261031270 None] Lock "cinder-18d020e2-e3a2-49ae-a0e0-c334a7811890-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:36 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 1073741824" returned: 0 in 0.497s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:36 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 Sep 05 21:06:36 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-dfa3e3da-9675-4656-a47c-4b149b3e0fb5-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-dfa3e3da-9675-4656-a47c-4b149b3e0fb5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:36 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4" returned: 0 in 0.315s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.109s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-quobyte-e94551ff-e45a-4a2d-9168-218ae6192aa3-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-quobyte-dfa3e3da-9675-4656-a47c-4b149b3e0fb5" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-e94551ff-e45a-4a2d-9168-218ae6192aa3-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Creating volume 2be8e7d2-e307-4681-81bf-d8d2bf0d895f from snapshot e94551ff-e45a-4a2d-9168-218ae6192aa3 {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-quobyte-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-dfa3e3da-9675-4656-a47c-4b149b3e0fb5" acquired by "delete_volume" :: waited 0.061s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9106978-3b6a-495c-8d84-51bd79063b54]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" acquired by "_copy_volume_from_snapshot" :: waited 0.077s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] snapshot: e94551ff-e45a-4a2d-9168-218ae6192aa3, volume: 2be8e7d2-e307-4681-81bf-d8d2bf0d895f, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Attempting download of f1afd029-5785-4e1c-a756-2e0fb4e89dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'metadata': {}}])) to volume c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b11c5-f72c-4d05-a1ab-222a080ec038]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bcb19b-845d-4d0b-819b-49591f2fc63b]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_oen8e0yw {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:37 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 Sep 05 21:06:37 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 Sep 05 21:06:37 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_oen8e0yw Sep 05 21:06:37 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5" returned: 0 in 0.461s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:37 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5 Sep 05 21:06:37 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_oen8e0yw" returned: 0 in 0.436s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_oen8e0yw {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:37 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3" returned: 0 in 0.503s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e266fdf6-447f-4b63-9f29-01b7c223062a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:37 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_oen8e0yw Sep 05 21:06:37 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 Sep 05 21:06:37 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-dfa3e3da-9675-4656-a47c-4b149b3e0fb5" returned: 0 in 0.389s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-dfa3e3da-9675-4656-a47c-4b149b3e0fb5" released by "delete_volume" :: held 0.969s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:37 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created reservations ['5cdf2739-f3c1-4ab6-ad5c-54b4949dec83', 'f98b67fb-0fb6-4746-a2eb-b618f4db7882', '8c252a36-49c6-4e16-9324-57b2bf38e8b8', '0be6e17e-78fa-415c-a929-4a1209224773'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:38 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:38 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:38 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_oen8e0yw" returned: 1 in 0.640s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_oen8e0yw' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d85b302-116e-4e93-a100-71d4e81a3e84]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:38 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13" returned: 0 in 0.626s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:38 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f Sep 05 21:06:38 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:38 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD Sep 05 21:06:38 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:38 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.457s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Deleted volume successfully. Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5b640912-4473-47b7-ab7a-cb1b64ea5506 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-dfa3e3da-9675-4656-a47c-4b149b3e0fb5-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:38 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:38 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD Sep 05 21:06:38 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:39 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD" returned: 1 in 0.470s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] f1afd029-5785-4e1c-a756-2e0fb4e89dd2 was raw, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:39 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 Sep 05 21:06:39 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-37d45291-e1e0-436d-aef7-4e858edba2f4-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-37d45291-e1e0-436d-aef7-4e858edba2f4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-quobyte-37d45291-e1e0-436d-aef7-4e858edba2f4" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-37d45291-e1e0-436d-aef7-4e858edba2f4" acquired by "delete_volume" :: waited 0.055s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf9fc2-9e52-4fe3-a337-fa717d8859c6]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:40 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 Sep 05 21:06:40 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:40 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4" returned: 0 in 0.762s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:40 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4" returned: 0 in 1.539s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:40 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f1afd029-5785-4e1c-a756-2e0fb4e89dd2_jwac59jddevstack@QuobyteHD, size 0.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:06:40 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 21:06:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:40 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4 Sep 05 21:06:40 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:40 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 1G Sep 05 21:06:40 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:41 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:41 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (eac9aa0d-8a8d-4042-a7d1-e75a656d53e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af8ea29-812d-4b5d-a20e-e0745cbfc59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 1G" returned: 0 in 0.927s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37d45291-e1e0-436d-aef7-4e858edba2f4" returned: 0 in 0.968s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Downloaded image f1afd029-5785-4e1c-a756-2e0fb4e89dd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'metadata': {}}])) to volume c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Temporary image f1afd029-5785-4e1c-a756-2e0fb4e89dd2 for user 10a08d64b03f4863987c1e9a2bb7bf2e is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Marking volume c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af8ea29-812d-4b5d-a20e-e0745cbfc59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-533732778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a585e3c-99b4-4b75-9540-08cd98559850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:41Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43c24fb-0e74-47d8-9e4d-7f0b408d1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43c24fb-0e74-47d8-9e4d-7f0b408d1224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202cc5a6-85d2-4b44-9b0b-b8d808e5b093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202cc5a6-85d2-4b44-9b0b-b8d808e5b093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a585e3c-99b4-4b75-9540-08cd98559850', 'volume_name': 'volume-6a585e3c-99b4-4b75-9540-08cd98559850', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0432dfc-6671-4050-81f4-3938d6eeaa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0432dfc-6671-4050-81f4-3938d6eeaa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9163992-bc2f-408e-ab18-db8861bbbe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:41 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume 6a585e3c-99b4-4b75-9540-08cd98559850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a585e3c-99b4-4b75-9540-08cd98559850', 'volume_size': 1} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-37d45291-e1e0-436d-aef7-4e858edba2f4" released by "delete_volume" :: held 1.995s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Copying metadata from image f1afd029-5785-4e1c-a756-2e0fb4e89dd2 to c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Creating volume glance metadata for volume c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 backed by image f1afd029-5785-4e1c-a756-2e0fb4e89dd2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4b06c910166722a02c1b2cc759e028fe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:06:41 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created reservations ['9cfd5d23-b8a0-4e2c-a46a-64b68f46078a', '9212f939-de5c-4e7a-8a88-206d35bb48ee', '15663ffd-5b86-43fa-a44d-33cd99d2d08e', 'faf25c78-8003-47f3-b417-d3cc3ff7403d'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632fc260-3887-4e7e-b5f2-cb305d0f3d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4', 'volume_size': 1, 'image_id': 'f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b06c910166722a02c1b2cc759e028fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6948208a7084fb3925af68800be63a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d3aa07488846699fd4e2be3579f10a96fe8a61622a339ebd2a70480d7c95c6cf8de7374a3105b88dcde231d008e0571b6f400e63bd7057ae3a65cb822677fa1', 'id': 'f1afd029-5785-4e1c-a756-2e0fb4e89dd2', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1afd029-5785-4e1c-a756-2e0fb4e89dd2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a788c2-1c22-45d1-8e9d-14e4d83d12ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:42 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Volume volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 (c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4): created successfully Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a788c2-1c22-45d1-8e9d-14e4d83d12ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Flow 'volume_create_manager' (5a9279a1-5484-4fe2-9763-d816ae7c2548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-546c3025-e5b3-4b01-b583-c6fafa910ebb tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Created volume successfully. Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:42 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:42 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:42 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.583s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:42 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:42 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Deleted volume successfully. Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-31df5006-daaf-485d-b7fd-7ad10b521f92 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-37d45291-e1e0-436d-aef7-4e858edba2f4-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Acquiring lock "cinder-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "cinder-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Acquiring lock "cinder-quobyte-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "cinder-quobyte-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4" acquired by "delete_volume" :: waited 0.046s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[43173f0f-d06a-4bdf-beb0-cb7727c7ff98]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-8c65404a-9d05-40a0-be0e-6313e7c396f4-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-8c65404a-9d05-40a0-be0e-6313e7c396f4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-quobyte-8c65404a-9d05-40a0-be0e-6313e7c396f4" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-8c65404a-9d05-40a0-be0e-6313e7c396f4" acquired by "delete_volume" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:43 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 Sep 05 21:06:43 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b143aa-8a4a-4080-8075-dab6234e8388]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:43 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 Sep 05 21:06:44 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:44 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4" returned: 0 in 0.973s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:44 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4 Sep 05 21:06:44 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:44 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" returned: 0 in 6.300s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:06:44 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Converted 1024.00 MB image at 162.50 MB/s Sep 05 21:06:44 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f is being set with open permissions: ugo+rw Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:44 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:44 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f Sep 05 21:06:44 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4" returned: 0 in 0.786s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:44 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4 Sep 05 21:06:44 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:44 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4" returned: 0 in 0.310s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "cinder-quobyte-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4" released by "delete_volume" :: held 1.396s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:44 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" returned: 0 in 0.249s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" released by "_copy_volume_from_snapshot" :: held 7.811s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:44 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-e94551ff-e45a-4a2d-9168-218ae6192aa3-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" released by "_create_volume_from_snapshot" :: held 7.960s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Created reservations ['2e0bfdc6-7bb7-4cc3-8b08-56dd38180092', 'b590f2c8-e2f9-40c6-b9d7-3f93f9bb8bc5', 'c36c4327-6fa2-41ee-b0d3-5c421c03dc81', '7297d2b4-7c6b-42ea-bcf1-4dcd386512ef'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.074s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-533732778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a585e3c-99b4-4b75-9540-08cd98559850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:41Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Creating volume 6a585e3c-99b4-4b75-9540-08cd98559850 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:44 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-8c65404a-9d05-40a0-be0e-6313e7c396f4" returned: 0 in 0.324s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:44 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 1073741824 Sep 05 21:06:44 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-8c65404a-9d05-40a0-be0e-6313e7c396f4" released by "delete_volume" :: held 1.196s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4ba6c2-a95a-4891-85c9-00fa090558b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f', 'volume_size': 1, 'snapshot_id': 'e94551ff-e45a-4a2d-9168-218ae6192aa3'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c512713b-45a3-4be2-85f8-7c00878d410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:44 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Volume volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f (2be8e7d2-e307-4681-81bf-d8d2bf0d895f): created successfully Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c512713b-45a3-4be2-85f8-7c00878d410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Flow 'volume_create_manager' (879a52c4-0396-403b-b8e4-6864494dc3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:44 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-20a14445-ae06-4c6a-a039-ab4ee659030e tempest-VolumeDependencyTests-1243655810 None] Created volume successfully. Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:44 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created reservations ['380824b3-64c8-4190-b6f2-5f5083d2de38', 'c2198aa9-a88c-4506-bf99-d5c208fd3111', '8f498ad8-8c3e-4b80-9d4a-f5a4a456ce72', '61c5ed71-8b96-428e-91a4-f1e8fc808974'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:44 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:44 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:45 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:45 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:45 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:45 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 1073741824" returned: 0 in 0.450s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.289s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Deleted volume successfully. Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8e1deab-7e00-468b-8e93-6da6ba820fe1 tempest-VolumeAndVolumeTypeFromImageTest-965663690 None] Lock "cinder-c55b5bb4-a03d-4e26-a5d7-eb9dbfc870a4-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:45 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 Sep 05 21:06:45 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:45 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.269s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Deleted volume successfully. Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2320b6dd-cc1c-428f-a180-34aea0ab4efa tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-8c65404a-9d05-40a0-be0e-6313e7c396f4-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:45 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850" returned: 0 in 0.264s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9163992-bc2f-408e-ab18-db8861bbbe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a585e3c-99b4-4b75-9540-08cd98559850', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9d7f00-e22b-4f4b-bb9f-6483b06871cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:45 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume volume-6a585e3c-99b4-4b75-9540-08cd98559850 (6a585e3c-99b4-4b75-9540-08cd98559850): created successfully Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9d7f00-e22b-4f4b-bb9f-6483b06871cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (eac9aa0d-8a8d-4042-a7d1-e75a656d53e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fa749260-7c92-48b8-b53b-bc410e129429 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created volume successfully. Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-e94551ff-e45a-4a2d-9168-218ae6192aa3-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-5f87cc31-24f8-4713-86ba-236022a0bf77-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-e94551ff-e45a-4a2d-9168-218ae6192aa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-quobyte-3ce1665c-34a3-4091-ab8f-f042a00a2e13" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-5f87cc31-24f8-4713-86ba-236022a0bf77-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-3ce1665c-34a3-4091-ab8f-f042a00a2e13" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-quobyte-e94551ff-e45a-4a2d-9168-218ae6192aa3" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-e94551ff-e45a-4a2d-9168-218ae6192aa3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Deleting offline snapshot e94551ff-e45a-4a2d-9168-218ae6192aa3 of volume 3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] snapshot_file for this snap is: volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a880b2-01d6-4e7f-8c12-0f898505c162]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-quobyte-5f87cc31-24f8-4713-86ba-236022a0bf77" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-5f87cc31-24f8-4713-86ba-236022a0bf77" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7eeb81-5d22-42c2-b088-647fdc0bad9c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:46 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 Sep 05 21:06:46 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:46 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 Sep 05 21:06:46 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:46 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3" returned: 0 in 0.426s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:06:46 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77" returned: 0 in 0.394s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[701752c4-14ae-4af4-bb24-c77332b04249]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:46 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77 Sep 05 21:06:46 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:46 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 Sep 05 21:06:46 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:46 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5f87cc31-24f8-4713-86ba-236022a0bf77" returned: 0 in 0.272s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-5f87cc31-24f8-4713-86ba-236022a0bf77" released by "delete_volume" :: held 0.713s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created reservations ['0491ef19-1194-4060-99ca-9b704ab0113f', '95141e0c-8cea-4142-ad68-ab8569036861', '4b579bc9-42d9-453c-8816-0618ba8851ee', '3c2b57ad-c167-4d6b-be22-7d1f8ea5c948'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:46 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:46 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Creating offline snapshot 2a3a46b4-a553-407e-8949-0115d4be5efa of volume 6a585e3c-99b4-4b75-9540-08cd98559850 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:06:47 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13" returned: 0 in 0.769s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e770fba6-e82d-42e3-b477-828e2ea3f4c8]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:47 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 Sep 05 21:06:47 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.422s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-quobyte-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Deleted volume successfully. Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e" acquired by "delete_volume" :: waited 0.050s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a4405aad-a341-4707-9061-d2ee4cfad19b tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-5f87cc31-24f8-4713-86ba-236022a0bf77-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:47 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 Sep 05 21:06:47 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[614809f7-57ec-40ca-95d2-9fd7ab6c4d67]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:47 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e Sep 05 21:06:47 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3" returned: 0 in 0.472s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:47 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3 Sep 05 21:06:47 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850" returned: 0 in 0.505s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:47 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa 1G Sep 05 21:06:47 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e" returned: 0 in 0.460s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:47 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e Sep 05 21:06:47 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13.e94551ff-e45a-4a2d-9168-218ae6192aa3" returned: 0 in 0.326s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-e94551ff-e45a-4a2d-9168-218ae6192aa3" released by "_delete_snapshot" :: held 2.140s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-3ce1665c-34a3-4091-ab8f-f042a00a2e13" released by "delete_snapshot" :: held 2.171s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Created reservations ['aa7fd713-ef86-4f62-aaec-69fb586a9b8f', '84a73620-bc50-4a56-85eb-d182ce3b759a', 'c586a475-af7c-467c-8765-113074e3a814', 'c29c3b26-886c-4fbb-beea-b5c40650a8a2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:48 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e" returned: 0 in 0.319s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e" released by "delete_volume" :: held 0.835s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Delete snapshot completed successfully. Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-42a47095-fea8-4aab-8589-e4dffbb2caf2 tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-e94551ff-e45a-4a2d-9168-218ae6192aa3-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created reservations ['0264a22e-f14d-4b5f-a5e1-a84ef239e1be', '4e5667db-d307-459f-b9d5-17bf00668de6', 'c549e309-f7c3-4309-a8a6-961cdb978159', '31fec7e3-8639-4c87-bf2c-1c515ad0d1c3'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:48 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa 1G" returned: 0 in 0.590s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a585e3c-99b4-4b75-9540-08cd98559850 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:48 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a585e3c-99b4-4b75-9540-08cd98559850 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa Sep 05 21:06:48 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:48 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:48 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:48 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a585e3c-99b4-4b75-9540-08cd98559850 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa" returned: 0 in 0.308s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa is being set with open permissions: ugo+rw Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:48 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.261s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:48 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Deleted volume successfully. Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-68ec3c1d-4c3a-4645-934b-67cb78af4fc6 tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-2f8cdf1c-3dd3-4a05-ba86-2aaf094c181e-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:48 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa" returned: 0 in 0.264s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:48 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.info Sep 05 21:06:48 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-3ce1665c-34a3-4091-ab8f-f042a00a2e13-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-3ce1665c-34a3-4091-ab8f-f042a00a2e13-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-quobyte-3ce1665c-34a3-4091-ab8f-f042a00a2e13" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:49 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.info" returned: 0 in 0.288s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:49 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.info is being set with open permissions: ugo+rw Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-3ce1665c-34a3-4091-ab8f-f042a00a2e13" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:49 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.info Sep 05 21:06:49 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6e8632-e461-4ff2-9ce3-fa10bae6b04d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:49 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 Sep 05 21:06:49 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-5618ceab-8a73-4d76-9e1b-ba5b5586eef1-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-5618ceab-8a73-4d76-9e1b-ba5b5586eef1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:49 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.info" returned: 0 in 0.292s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "cinder-quobyte-5618ceab-8a73-4d76-9e1b-ba5b5586eef1" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3392ba72-68cf-4b95-917d-6d6a21708a01 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Create snapshot completed successfully Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-5618ceab-8a73-4d76-9e1b-ba5b5586eef1" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b008a8-c7f7-442e-aa3d-de2616d5fd98]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:49 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13" returned: 0 in 0.444s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:49 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 Sep 05 21:06:49 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:49 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13 Sep 05 21:06:49 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:49 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3ce1665c-34a3-4091-ab8f-f042a00a2e13" returned: 0 in 0.271s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-3ce1665c-34a3-4091-ab8f-f042a00a2e13" released by "delete_volume" :: held 0.788s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:49 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1" returned: 0 in 0.421s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:50 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1 Sep 05 21:06:50 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Created reservations ['484bfc87-6208-4e97-9b96-bda8df2fe297', '712ff369-9d72-485e-98f7-d8150a89f34a', 'a40f03ca-76eb-49f5-ae72-e167040cb9ca', '65ea37a8-a681-4d30-ae7a-55001401dc30'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:50 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:50 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:50 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-2be8e7d2-e307-4681-81bf-d8d2bf0d895f-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-2be8e7d2-e307-4681-81bf-d8d2bf0d895f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-5618ceab-8a73-4d76-9e1b-ba5b5586eef1" returned: 0 in 0.450s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-quobyte-5618ceab-8a73-4d76-9e1b-ba5b5586eef1" released by "delete_volume" :: held 0.951s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "cinder-quobyte-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:50 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" acquired by "delete_volume" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.445s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:50 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Deleted volume successfully. Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eb382b-9a95-4331-8440-47a458acd3b9]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-affbff16-0d6d-410b-a565-6d3e6cc2cdfb tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-3ce1665c-34a3-4091-ab8f-f042a00a2e13-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Created reservations ['78023b78-63e2-41d1-baf6-064773732b38', '4951f23f-d00a-487a-a8fe-31175111910d', 'ade6a8e7-7b83-4362-9edd-54ab004565bd', 'b673c29e-c76a-4804-a48b-56884691dd76'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:50 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f Sep 05 21:06:50 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:50 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:50 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (9fd79628-c320-4ad2-8495-adb5fcf1de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11febd96-8fca-4e2d-a8cb-f730fee0a9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11febd96-8fca-4e2d-a8cb-f730fee0a9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587735622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:51Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195944c8-352f-4557-9a88-cb8d9eaea2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195944c8-352f-4557-9a88-cb8d9eaea2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b246bb-64f0-41a4-84db-4e17f87e7372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b246bb-64f0-41a4-84db-4e17f87e7372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e', 'volume_name': 'volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6cadb3-910a-46ac-adc4-1342589ab5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6cadb3-910a-46ac-adc4-1342589ab5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e04de-6539-4d72-b77f-3509556f2fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume 4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e', 'volume_size': 1} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587735622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:51Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Creating volume 4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:51 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:51 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e 1073741824 Sep 05 21:06:51 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:51 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.393s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Deleted volume successfully. Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5024ecce-ffb4-4112-8aa1-310641daedae tempest-CreateVolumesFromSourceVolumeTest-958035557 None] Lock "cinder-5618ceab-8a73-4d76-9e1b-ba5b5586eef1-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:51 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" returned: 0 in 0.739s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:51 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f Sep 05 21:06:51 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (7e2b6f43-9712-4c76-beb4-7198b1bb5357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce824bc-c00c-43e7-8c43-9996c1e4764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce824bc-c00c-43e7-8c43-9996c1e4764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894471987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f93e44-8fc5-4b8e-9f25-c90787e558e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:52Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53f4655-f310-4293-9f56-89ca0f0d8dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53f4655-f310-4293-9f56-89ca0f0d8dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80d8092-128f-406f-8534-94fa1dd6f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80d8092-128f-406f-8534-94fa1dd6f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f93e44-8fc5-4b8e-9f25-c90787e558e8', 'volume_name': 'volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c637af2b-9780-497d-9035-8474e117ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c637af2b-9780-497d-9035-8474e117ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5800e4f4-3e1d-495e-a25b-40d3e86eacdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:51 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume 37f93e44-8fc5-4b8e-9f25-c90787e558e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8', 'volume_size': 1} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" returned: 0 in 0.402s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-quobyte-2be8e7d2-e307-4681-81bf-d8d2bf0d895f" released by "delete_volume" :: held 1.215s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Created reservations ['d41da02f-aa58-436e-bb4c-0983e4a622b0', 'a5be824b-a4a9-446e-9a5a-078ed7fba847', 'efc29994-948e-4eb9-b7ea-da6c269ce082', '9d59b36b-22af-4f7d-9b14-b450b06736c5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:51 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e 1073741824" returned: 0 in 0.732s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:52 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:52 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:52 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e Sep 05 21:06:52 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:52 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (0c24c72d-1d5f-4279-bcba-1283d884d344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac210a8b-c495-4bc3-90db-fe314572bfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:52 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e" returned: 0 in 0.455s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894471987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f93e44-8fc5-4b8e-9f25-c90787e558e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:52Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Creating volume 37f93e44-8fc5-4b8e-9f25-c90787e558e8 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:52 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.521s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac210a8b-c495-4bc3-90db-fe314572bfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-504705870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c033d54-0d24-44d5-9ee5-ebe2d456a7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:52Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a7622b-205b-4463-9a09-cdd567b20fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:52 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 1073741824 Sep 05 21:06:52 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a7622b-205b-4463-9a09-cdd567b20fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8641b46-c81e-432b-b40c-68db56d4f982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8641b46-c81e-432b-b40c-68db56d4f982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c033d54-0d24-44d5-9ee5-ebe2d456a7f1', 'volume_name': 'volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3d665a-a809-4214-82e7-4d9ee5b5edc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3d665a-a809-4214-82e7-4d9ee5b5edc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6393320b-c0a0-400b-8f6d-d8211ddba6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume 0c033d54-0d24-44d5-9ee5-ebe2d456a7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1', 'volume_size': 1} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Deleted volume successfully. Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e04de-6539-4d72-b77f-3509556f2fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0749a4-f1ca-45ae-a136-b21f175b9020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-333967a1-3ada-40c2-854a-481fa2a1805a tempest-VolumeDependencyTests-1243655810 None] Lock "cinder-2be8e7d2-e307-4681-81bf-d8d2bf0d895f-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e (4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e): created successfully Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0749a4-f1ca-45ae-a136-b21f175b9020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (9fd79628-c320-4ad2-8495-adb5fcf1de47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2b05a9e4-007c-4f2d-b82f-b384b35c7685 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created volume successfully. Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (5e3e6565-776d-4aca-86e5-445250f2759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:53 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f15ff03-459c-4da6-849d-8ab4d2523c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 1073741824" returned: 0 in 0.732s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f15ff03-459c-4da6-849d-8ab4d2523c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-626255644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ed265-0ccc-4856-bcc9-dde4e8911042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:53Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42b4646-d309-4b76-80bf-efbb1085d51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42b4646-d309-4b76-80bf-efbb1085d51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6730c7c-b064-4a9d-ab7f-5a60617ee493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6730c7c-b064-4a9d-ab7f-5a60617ee493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407ed265-0ccc-4856-bcc9-dde4e8911042', 'volume_name': 'volume-407ed265-0ccc-4856-bcc9-dde4e8911042', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4a44b9-9923-46bc-8da9-da11b1102ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4a44b9-9923-46bc-8da9-da11b1102ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec92792-7821-48a2-b9cc-591a4a341adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:53 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume 407ed265-0ccc-4856-bcc9-dde4e8911042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407ed265-0ccc-4856-bcc9-dde4e8911042', 'volume_size': 1} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:53 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 Sep 05 21:06:53 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:53 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-504705870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c033d54-0d24-44d5-9ee5-ebe2d456a7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:52Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Creating volume 0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:53 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5800e4f4-3e1d-495e-a25b-40d3e86eacdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:53 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 1073741824 Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d593eab5-160c-4650-8ce7-22f7f242d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:53 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:53 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 (37f93e44-8fc5-4b8e-9f25-c90787e558e8): created successfully Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d593eab5-160c-4650-8ce7-22f7f242d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (7e2b6f43-9712-4c76-beb4-7198b1bb5357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:53 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ecfb82c3-c3fe-48ad-93e9-38a3656b5aa1 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created volume successfully. Sep 05 21:06:53 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (e0a8cb5f-222d-4a73-9d43-22ca508e2cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8b6c7-17d5-4d0d-aed1-4f9fb30c6bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8b6c7-17d5-4d0d-aed1-4f9fb30c6bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2124707039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4237fec9-b6d2-413c-a3e5-1d096472f2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:54Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92cdb2b2-960b-4fea-aad5-5982f38b48b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92cdb2b2-960b-4fea-aad5-5982f38b48b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887ef5c2-2e3b-4986-89d1-152f6bd11e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887ef5c2-2e3b-4986-89d1-152f6bd11e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4237fec9-b6d2-413c-a3e5-1d096472f2fe', 'volume_name': 'volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df2a2fb-b5ef-4252-92f1-161c182b1637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df2a2fb-b5ef-4252-92f1-161c182b1637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5b504a-a299-4ea3-ad1a-0ed63e079205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:54 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume 4237fec9-b6d2-413c-a3e5-1d096472f2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe', 'volume_size': 1} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:54 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 1073741824" returned: 0 in 0.725s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:54 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 Sep 05 21:06:54 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:54 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1" returned: 0 in 0.422s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-626255644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ed265-0ccc-4856-bcc9-dde4e8911042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:53Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Creating volume 407ed265-0ccc-4856-bcc9-dde4e8911042 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:55 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6393320b-c0a0-400b-8f6d-d8211ddba6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bc6b05-19b5-4610-a022-c57e352600b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:55 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 1073741824 Sep 05 21:06:55 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:55 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 (0c033d54-0d24-44d5-9ee5-ebe2d456a7f1): created successfully Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bc6b05-19b5-4610-a022-c57e352600b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (0c24c72d-1d5f-4279-bcba-1283d884d344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b25d8806-a3d8-4edc-a726-69b5bed36dbc tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created volume successfully. Sep 05 21:06:55 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 1073741824" returned: 0 in 0.576s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:55 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:55 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:55 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:55 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Flow 'volume_create_manager' (4882fc2d-bc5d-40dc-ba63-34bae2fab0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03c5a80-d48a-4bca-8178-81ad4a92f19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03c5a80-d48a-4bca-8178-81ad4a92f19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2140359-8f0a-42a0-a49d-9623b1b6c895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d7943d658c4252bae5368943d1935d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:56Z,use_quota=True,user_id='da5bdaab96cb481692b44791c1fec359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454a9677-73a7-4c4d-86c0-9c2bb3f3ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454a9677-73a7-4c4d-86c0-9c2bb3f3ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922a4129-2aaa-4351-884e-348f63a0b4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.image.glance [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Creating Keystone auth plugin from conf {{(pid=87802) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:06:56 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042" returned: 0 in 0.389s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2124707039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4237fec9-b6d2-413c-a3e5-1d096472f2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a447705b03401b97e88262c40c5bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:54Z,use_quota=True,user_id='69497e80666d4f589bccb83fd671063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Creating volume 4237fec9-b6d2-413c-a3e5-1d096472f2fe {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:56 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:56 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.406s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec92792-7821-48a2-b9cc-591a4a341adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407ed265-0ccc-4856-bcc9-dde4e8911042', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a079d648-98ce-43fa-9407-f4532b3abf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:56 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe 1073741824 Sep 05 21:06:56 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:56 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume volume-407ed265-0ccc-4856-bcc9-dde4e8911042 (407ed265-0ccc-4856-bcc9-dde4e8911042): created successfully Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a079d648-98ce-43fa-9407-f4532b3abf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (5e3e6565-776d-4aca-86e5-445250f2759e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-da79c53a-3ad5-4163-a8a5-639274be0788 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created volume successfully. Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922a4129-2aaa-4351-884e-348f63a0b4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2140359-8f0a-42a0-a49d-9623b1b6c895', 'volume_name': 'volume-e2140359-8f0a-42a0-a49d-9623b1b6c895', 'volume_size': 1, 'image_id': '1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5794c3e5d4e4d21dde3a731ecc5965b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72d7943d658c4252bae5368943d1935d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9915e897797f99f00e3b4e3e75095da5dbfe49bde783e28ec433fe2d1d90a119c1427ce7e13ea955548f43751776cdca7f808ff21b40aaf69c2fe858802f479b', 'id': '1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54/file', 'properties': {}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c2ef9b-8f6e-4351-b37f-6082c30e3f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c2ef9b-8f6e-4351-b37f-6082c30e3f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f3638c-0b45-4dde-bbd7-dcdc3b960087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:56 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Volume e2140359-8f0a-42a0-a49d-9623b1b6c895: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2140359-8f0a-42a0-a49d-9623b1b6c895', 'volume_size': 1, 'image_id': '1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5794c3e5d4e4d21dde3a731ecc5965b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72d7943d658c4252bae5368943d1935d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9915e897797f99f00e3b4e3e75095da5dbfe49bde783e28ec433fe2d1d90a119c1427ce7e13ea955548f43751776cdca7f808ff21b40aaf69c2fe858802f479b', 'id': '1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54/file', 'properties': {}}, 'image_service': } Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Trying to clone e2140359-8f0a-42a0-a49d-9623b1b6c895 from image 1cdb7089-183a-4ccc-83fe-4cf63fbccb54 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'metadata': {}}]). {{(pid=87802) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:06:56 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Image download 0.00 MB at 0.00 MB/s Sep 05 21:06:56 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe 1073741824" returned: 0 in 0.677s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e7c4f-26a6-404b-af48-a8fc35314d07]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:56 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe Sep 05 21:06:56 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:56 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD Sep 05 21:06:56 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:57 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe" returned: 0 in 0.319s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5b504a-a299-4ea3-ad1a-0ed63e079205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9e64e8-93b6-45fa-aa4f-031f5d808e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:57 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Volume volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe (4237fec9-b6d2-413c-a3e5-1d096472f2fe): created successfully Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9e64e8-93b6-45fa-aa4f-031f5d808e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Flow 'volume_create_manager' (e0a8cb5f-222d-4a73-9d43-22ca508e2cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:57 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3b01cc53-9fea-43e4-af07-b0c6c15c08bf tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created volume successfully. Sep 05 21:06:57 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:57 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD Sep 05 21:06:57 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-4237fec9-b6d2-413c-a3e5-1d096472f2fe-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-4237fec9-b6d2-413c-a3e5-1d096472f2fe-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-quobyte-4237fec9-b6d2-413c-a3e5-1d096472f2fe" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-4237fec9-b6d2-413c-a3e5-1d096472f2fe" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:57 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Temporary image 1cdb7089-183a-4ccc-83fe-4cf63fbccb54 is fetched for user da5bdaab96cb481692b44791c1fec359. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2915f569-f195-4a34-b79d-90f31c485697]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d10aa9c-c579-4f65-a520-b1e1a33bf25e]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:57 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe Sep 05 21:06:57 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:57 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD Sep 05 21:06:57 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (618d0573-5af8-46f8-b757-30b2e59caf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2027882-be13-43c3-96fd-87106681ea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2027882-be13-43c3-96fd-87106681ea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233576830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d3b57f-b297-40d2-a045-adbdddc82170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:58Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556de838-88f8-462a-a564-b22e422b2adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556de838-88f8-462a-a564-b22e422b2adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f6aef5-b458-4031-a05a-87b0bb004619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f6aef5-b458-4031-a05a-87b0bb004619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d3b57f-b297-40d2-a045-adbdddc82170', 'volume_name': 'volume-68d3b57f-b297-40d2-a045-adbdddc82170', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f352a1-1c68-48f2-b365-dabf323b4f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f352a1-1c68-48f2-b365-dabf323b4f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14881d0e-374d-4529-93a7-9c0bf0283573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Volume 68d3b57f-b297-40d2-a045-adbdddc82170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d3b57f-b297-40d2-a045-adbdddc82170', 'volume_size': 1} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233576830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d3b57f-b297-40d2-a045-adbdddc82170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:58Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Creating volume 68d3b57f-b297-40d2-a045-adbdddc82170 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:58 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe" returned: 0 in 0.585s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 1073741824 Sep 05 21:06:58 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe Sep 05 21:06:58 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD Sep 05 21:06:58 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4237fec9-b6d2-413c-a3e5-1d096472f2fe" returned: 0 in 0.272s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-4237fec9-b6d2-413c-a3e5-1d096472f2fe" released by "delete_volume" :: held 0.924s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:58 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created reservations ['55bfb269-e9ca-4c24-ab92-356855911d1c', 'ca6a7554-14ca-48f0-bc66-d247cfd25a6c', '1c8e92b7-7473-43d3-b8e7-215a85e9c4a8', 'a575ef85-8d03-4b7c-8db0-864a0df5e487'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:06:58 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 1073741824" returned: 0 in 0.540s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 Sep 05 21:06:58 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:59 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.298s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Deleted volume successfully. Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-848989ec-c4f3-4ec5-93de-33f844f3e895 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-4237fec9-b6d2-413c-a3e5-1d096472f2fe-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:59 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170" returned: 0 in 0.275s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2140359-8f0a-42a0-a49d-9623b1b6c895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d7943d658c4252bae5368943d1935d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:56Z,use_quota=True,user_id='da5bdaab96cb481692b44791c1fec359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Creating volume e2140359-8f0a-42a0-a49d-9623b1b6c895 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:06:59 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14881d0e-374d-4529-93a7-9c0bf0283573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d3b57f-b297-40d2-a045-adbdddc82170', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e544ce32-a363-4100-921d-7c993b2f74ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:59 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 1073741824 Sep 05 21:06:59 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Volume volume-68d3b57f-b297-40d2-a045-adbdddc82170 (68d3b57f-b297-40d2-a045-adbdddc82170): created successfully Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e544ce32-a363-4100-921d-7c993b2f74ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (618d0573-5af8-46f8-b757-30b2e59caf18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-629e8704-5bd9-42a7-ac5b-17a832fe12e9 tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:06:59 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 1073741824" returned: 0 in 0.450s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:59 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 Sep 05 21:06:59 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:59 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Attempting download of 1cdb7089-183a-4ccc-83fe-4cf63fbccb54 ((None, [{'url': 'file:///opt/stack/data/glance/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'metadata': {}}])) to volume e2140359-8f0a-42a0-a49d-9623b1b6c895. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[196acf5b-3798-45e7-b9a5-e391cb9afb2c]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_uau8lllv {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-407ed265-0ccc-4856-bcc9-dde4e8911042-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-407ed265-0ccc-4856-bcc9-dde4e8911042-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-quobyte-407ed265-0ccc-4856-bcc9-dde4e8911042" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-407ed265-0ccc-4856-bcc9-dde4e8911042" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:00 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_uau8lllv Sep 05 21:07:00 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c70191-371e-4881-a793-f316aba91e87]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 Sep 05 21:07:00 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_uau8lllv" returned: 0 in 0.466s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_uau8lllv {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_uau8lllv Sep 05 21:07:00 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042" returned: 0 in 0.511s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042 Sep 05 21:07:00 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot 2b012408-e29d-4d61-9ad4-e0e81aaf6e1c of volume 68d3b57f-b297-40d2-a045-adbdddc82170 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee8ebc9-8df2-4204-bd7d-7125a3a2a62c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_uau8lllv" returned: 1 in 0.401s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_uau8lllv' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11bb57d-16c6-4540-92c4-00077267b8c7]: (4, 'raw') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 Sep 05 21:07:00 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD Sep 05 21:07:00 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:01 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-407ed265-0ccc-4856-bcc9-dde4e8911042" returned: 0 in 0.279s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-407ed265-0ccc-4856-bcc9-dde4e8911042" released by "delete_volume" :: held 0.858s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created reservations ['70eb2eaa-1d45-402d-928b-11d4312b6e22', 'e4e614d4-dcb7-4fb4-9db5-cce6b1e8877b', '7a4746f5-dbad-47b5-96d9-699662f91345', '7a36c83c-84db-44d4-8d6b-5663e51cac91'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:01 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:01 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170" returned: 0 in 0.536s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c 1G Sep 05 21:07:01 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-quobyte-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3850584-43ce-4312-84f3-117f05f10754]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD Sep 05 21:07:01 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:01 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 Sep 05 21:07:01 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:01 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.468s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:01 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Deleted volume successfully. Sep 05 21:07:01 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD" returned: 1 in 0.447s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] 1cdb7089-183a-4ccc-83fe-4cf63fbccb54 was raw, converting to qcow2 {{(pid=87802) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f960dc4-e6db-4355-8790-ee20fa058c5b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-407ed265-0ccc-4856-bcc9-dde4e8911042-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:01 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 Sep 05 21:07:01 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:01 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1" returned: 0 in 0.439s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c 1G" returned: 0 in 0.542s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d3b57f-b297-40d2-a045-adbdddc82170 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1 Sep 05 21:07:01 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:01 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d3b57f-b297-40d2-a045-adbdddc82170 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c Sep 05 21:07:01 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:02 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1" returned: 0 in 0.360s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d3b57f-b297-40d2-a045-adbdddc82170 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c" returned: 0 in 0.362s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:02 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c is being set with open permissions: ugo+rw Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1" released by "delete_volume" :: held 0.863s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:02 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c Sep 05 21:07:02 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895" returned: 0 in 0.590s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cdb7089-183a-4ccc-83fe-4cf63fbccb54_sbzzeh8ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:07:02 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:02 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 1G Sep 05 21:07:02 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created reservations ['24a0d355-6067-47ba-8464-67781bfefbe1', '04c7db30-8388-43be-9465-89be9bab0eb0', 'bca6246e-b366-47eb-ac23-e32b4752957b', 'ae9f0f31-0a4c-4497-8f75-541f112419d1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:02 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:02 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-37f93e44-8fc5-4b8e-9f25-c90787e558e8-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-37f93e44-8fc5-4b8e-9f25-c90787e558e8-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-quobyte-37f93e44-8fc5-4b8e-9f25-c90787e558e8" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:02 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-37f93e44-8fc5-4b8e-9f25-c90787e558e8" acquired by "delete_volume" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c" returned: 0 in 0.438s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa48ab8-5155-4854-a32a-ce976ff71472]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:02 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:02 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.info Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.326s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:02 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Deleted volume successfully. Sep 05 21:07:02 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 1G" returned: 0 in 0.503s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Downloaded image 1cdb7089-183a-4ccc-83fe-4cf63fbccb54 ((None, [{'url': 'file:///opt/stack/data/glance/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'metadata': {}}])) to volume e2140359-8f0a-42a0-a49d-9623b1b6c895 successfully. {{(pid=87802) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Temporary image 1cdb7089-183a-4ccc-83fe-4cf63fbccb54 for user da5bdaab96cb481692b44791c1fec359 is deleted. {{(pid=87802) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.volume_utils [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Marking volume e2140359-8f0a-42a0-a49d-9623b1b6c895 as bootable. {{(pid=87802) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Copying metadata from image 1cdb7089-183a-4ccc-83fe-4cf63fbccb54 to e2140359-8f0a-42a0-a49d-9623b1b6c895. {{(pid=87802) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Creating volume glance metadata for volume e2140359-8f0a-42a0-a49d-9623b1b6c895 backed by image 1cdb7089-183a-4ccc-83fe-4cf63fbccb54 with: {'image_id': '1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5794c3e5d4e4d21dde3a731ecc5965b0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87802) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e8273ebc-8f05-4649-8a33-2f055c7634f7 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-0c033d54-0d24-44d5-9ee5-ebe2d456a7f1-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:02 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 Sep 05 21:07:02 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f3638c-0b45-4dde-bbd7-dcdc3b960087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2140359-8f0a-42a0-a49d-9623b1b6c895', 'volume_size': 1, 'image_id': '1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5794c3e5d4e4d21dde3a731ecc5965b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72d7943d658c4252bae5368943d1935d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9915e897797f99f00e3b4e3e75095da5dbfe49bde783e28ec433fe2d1d90a119c1427ce7e13ea955548f43751776cdca7f808ff21b40aaf69c2fe858802f479b', 'id': '1cdb7089-183a-4ccc-83fe-4cf63fbccb54', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdb7089-183a-4ccc-83fe-4cf63fbccb54/file', 'properties': {}}, 'image_service': }' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac54e01f-01a3-491d-afea-715ad81729eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:02 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Volume volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 (e2140359-8f0a-42a0-a49d-9623b1b6c895): created successfully Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac54e01f-01a3-491d-afea-715ad81729eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Flow 'volume_create_manager' (4882fc2d-bc5d-40dc-ba63-34bae2fab0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:02 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-28d1a0d6-9086-438e-a01e-2e80708a1254 tempest-VolumeImageDependencyTests-858183336 None] Created volume successfully. Sep 05 21:07:03 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.info" returned: 0 in 0.336s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:03 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.info is being set with open permissions: ugo+rw Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:03 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.info Sep 05 21:07:03 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:03 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8" returned: 0 in 0.450s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:03 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8 Sep 05 21:07:03 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Acquiring lock "cinder-e2140359-8f0a-42a0-a49d-9623b1b6c895-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:03 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.info" returned: 0 in 0.321s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Lock "cinder-e2140359-8f0a-42a0-a49d-9623b1b6c895-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-b540d8ea-968f-44fe-a42c-bcd4dcbd5ea1 tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:07:03 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-37f93e44-8fc5-4b8e-9f25-c90787e558e8" returned: 0 in 0.337s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Acquiring lock "cinder-quobyte-e2140359-8f0a-42a0-a49d-9623b1b6c895" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-37f93e44-8fc5-4b8e-9f25-c90787e558e8" released by "delete_volume" :: held 0.844s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Lock "cinder-quobyte-e2140359-8f0a-42a0-a49d-9623b1b6c895" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3369dcae-67eb-46fb-8e6b-bc485c7dbe18]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created reservations ['338b497f-70d6-48ec-bb6d-12e1912364df', 'b974f94c-a376-4e6d-8e58-65a43225dd57', '7c1b49a0-8270-470b-950b-50210963972d', '00d9af9b-d89d-4e88-b4de-d623355f660f'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:03 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 Sep 05 21:07:03 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Flow 'volume_create_manager' (395c4b88-6a78-4039-b7af-b7d749010364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b752d90-ab4b-40de-98ef-243cbe182328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b752d90-ab4b-40de-98ef-243cbe182328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102761217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002659fb-be73-4ce0-8be4-0ca270838c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed926d736de40639867010eef3ce1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:04Z,use_quota=True,user_id='d7436dcdee254c81b0886b6b50f292ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:03 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:03 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff9ae68-c141-4b02-8035-2143ceb31425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff9ae68-c141-4b02-8035-2143ceb31425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988608a5-f788-4609-9b62-b873c8a441cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988608a5-f788-4609-9b62-b873c8a441cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002659fb-be73-4ce0-8be4-0ca270838c2e', 'volume_name': 'volume-002659fb-be73-4ce0-8be4-0ca270838c2e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ff6e1e-6406-44af-ad88-2454cf830e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ff6e1e-6406-44af-ad88-2454cf830e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c3060a-789e-4230-9b31-219e214f4d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:03 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Volume 002659fb-be73-4ce0-8be4-0ca270838c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002659fb-be73-4ce0-8be4-0ca270838c2e', 'volume_size': 1} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102761217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002659fb-be73-4ce0-8be4-0ca270838c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed926d736de40639867010eef3ce1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:04Z,use_quota=True,user_id='d7436dcdee254c81b0886b6b50f292ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Creating volume 002659fb-be73-4ce0-8be4-0ca270838c2e {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:03 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:03 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e 1073741824 Sep 05 21:07:03 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-quobyte-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e" acquired by "delete_volume" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127f9ec-7ee2-44b1-a514-55f7a3c8dcb3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-2b012408-e29d-4d61-9ad4-e0e81aaf6e1c-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Lock "cinder-2b012408-e29d-4d61-9ad4-e0e81aaf6e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-68d3b57f-b297-40d2-a045-adbdddc82170" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-68d3b57f-b297-40d2-a045-adbdddc82170" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-2b012408-e29d-4d61-9ad4-e0e81aaf6e1c" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:04 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895" returned: 0 in 0.518s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:04 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-2b012408-e29d-4d61-9ad4-e0e81aaf6e1c" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot 2b012408-e29d-4d61-9ad4-e0e81aaf6e1c of volume 68d3b57f-b297-40d2-a045-adbdddc82170 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:04 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895 Sep 05 21:07:04 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:04 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e Sep 05 21:07:04 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.401s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddb4880-0f76-454a-b58e-b94e14f06669]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:04 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Deleted volume successfully. Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e1dedaea-001e-4060-a996-26727e42cf9b tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-37f93e44-8fc5-4b8e-9f25-c90787e558e8-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:04 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c Sep 05 21:07:04 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:04 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e2140359-8f0a-42a0-a49d-9623b1b6c895" returned: 0 in 0.337s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:04 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e 1073741824" returned: 0 in 0.619s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Lock "cinder-quobyte-e2140359-8f0a-42a0-a49d-9623b1b6c895" released by "delete_volume" :: held 0.907s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:04 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e" returned: 0 in 0.482s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:04 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e Sep 05 21:07:04 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:04 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e Sep 05 21:07:04 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Created reservations ['3d691c35-d23f-4628-bf4d-e2a8959d635c', '483d8867-215f-43b2-87ee-77c164a43413', '95752a69-621a-4e87-824d-040b32f790cc', '04aa9f93-5ac6-4593-9a52-5e070dd80396'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:04 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c" returned: 0 in 0.494s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68d3b57f-b297-40d2-a045-adbdddc82170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3259e657-f992-4600-8dcd-005548304a8e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:04 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:04 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:04 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e" returned: 0 in 0.319s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e" released by "delete_volume" :: held 0.858s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:04 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e" returned: 0 in 0.320s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c3060a-789e-4230-9b31-219e214f4d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002659fb-be73-4ce0-8be4-0ca270838c2e', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:04 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7449361-461b-4892-808e-32eea5257814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:04 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:04 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Volume volume-002659fb-be73-4ce0-8be4-0ca270838c2e (002659fb-be73-4ce0-8be4-0ca270838c2e): created successfully Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7449361-461b-4892-808e-32eea5257814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Flow 'volume_create_manager' (395c4b88-6a78-4039-b7af-b7d749010364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:04 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7731c68b-fdd2-4c01-8e8d-41d67fa1ca88 tempest-ProjectReaderTests-1491894152 None] Created volume successfully. Sep 05 21:07:04 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created reservations ['3211e163-ccf6-414b-b676-736ba2510fad', '00e2f743-1c12-4e0e-9af4-8184f5a9c215', '33390d80-4a30-44fe-9090-b2e18b77cce1', '73d46fcc-4d1e-4621-9048-af0771ce996a'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:05 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.308s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Deleted volume successfully. Sep 05 21:07:05 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:05 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7dec0496-be82-49cd-9888-e32c48f27664 tempest-VolumeImageDependencyTests-858183336 None] Lock "cinder-e2140359-8f0a-42a0-a49d-9623b1b6c895-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:05 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170" returned: 0 in 0.438s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:05 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c Sep 05 21:07:05 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:05 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.270s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Deleted volume successfully. Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c7bd37aa-cf24-4b12-9f57-fe8ccf698c3f tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-4a0b1f41-80a1-46a0-8084-b3f2b57d4c2e-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:05 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c" returned: 0 in 0.337s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:05 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c Sep 05 21:07:05 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:05 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170.2b012408-e29d-4d61-9ad4-e0e81aaf6e1c" returned: 0 in 0.259s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-2b012408-e29d-4d61-9ad4-e0e81aaf6e1c" released by "_delete_snapshot" :: held 1.677s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-68d3b57f-b297-40d2-a045-adbdddc82170" released by "delete_snapshot" :: held 1.728s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Created reservations ['3c68e9fb-f4cb-44ab-b43b-8f0f533ad496', '1d956c2f-b028-4f65-973d-d1317936a01a', '68afb587-6e32-4b57-83c4-2a49416d5725', '3684b25d-7101-4436-84cd-0b52b7ff6f92'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:07:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bdcd68b6-8b76-42ce-8b9d-f68ab686198e tempest-ProjectMemberTests-1941667694 None] Lock "cinder-2b012408-e29d-4d61-9ad4-e0e81aaf6e1c-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "cinder-002659fb-be73-4ce0-8be4-0ca270838c2e-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-2a3a46b4-a553-407e-8949-0115d4be5efa-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-2a3a46b4-a553-407e-8949-0115d4be5efa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-quobyte-6a585e3c-99b4-4b75-9540-08cd98559850" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Lock "cinder-002659fb-be73-4ce0-8be4-0ca270838c2e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-6a585e3c-99b4-4b75-9540-08cd98559850" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-quobyte-2a3a46b4-a553-407e-8949-0115d4be5efa" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "cinder-quobyte-002659fb-be73-4ce0-8be4-0ca270838c2e" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-2a3a46b4-a553-407e-8949-0115d4be5efa" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Deleting offline snapshot 2a3a46b4-a553-407e-8949-0115d4be5efa of volume 6a585e3c-99b4-4b75-9540-08cd98559850 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] snapshot_file for this snap is: volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb38328-88ad-416c-8ca5-647f8a3887d2]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Lock "cinder-quobyte-002659fb-be73-4ce0-8be4-0ca270838c2e" acquired by "delete_volume" :: waited 0.068s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-68d3b57f-b297-40d2-a045-adbdddc82170-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64b01b-95b8-4d28-a422-c54912138da7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-68d3b57f-b297-40d2-a045-adbdddc82170-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-68d3b57f-b297-40d2-a045-adbdddc82170" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-68d3b57f-b297-40d2-a045-adbdddc82170" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa Sep 05 21:07:06 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[097fb9c7-c873-4b2a-8882-976d06a0cb41]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:06 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e Sep 05 21:07:06 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:06 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 Sep 05 21:07:06 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:06 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa" returned: 0 in 0.456s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a585e3c-99b4-4b75-9540-08cd98559850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5f174-cab4-49d3-9fbc-f3d9a658bd48]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:06 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e" returned: 0 in 0.505s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:06 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e Sep 05 21:07:06 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:06 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 Sep 05 21:07:06 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:06 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170" returned: 0 in 0.447s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:06 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170 Sep 05 21:07:06 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:07 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-002659fb-be73-4ce0-8be4-0ca270838c2e" returned: 0 in 0.348s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Lock "cinder-quobyte-002659fb-be73-4ce0-8be4-0ca270838c2e" released by "delete_volume" :: held 0.925s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:07 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850" returned: 0 in 0.478s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:07 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-68d3b57f-b297-40d2-a045-adbdddc82170" returned: 0 in 0.347s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:07 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa Sep 05 21:07:07 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-68d3b57f-b297-40d2-a045-adbdddc82170" released by "delete_volume" :: held 0.882s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Created reservations ['7d79b844-67fa-4f15-af88-d4805bf034d1', '74dc66d9-f547-4a13-a407-ba6b671435f9', '17e73ed2-6d91-44d5-9cec-abeb9594a385', '9fb0c09c-2599-4479-9ff0-851ca8ccde73'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Created reservations ['f28a2a2d-9ad1-4994-a742-a8517aa5e866', '3a707993-55e5-4150-af7f-920266980292', '8d13b15c-1e64-4f5f-ad64-edc97c377105', '632f22ad-7ce2-4660-9793-6d77789a628e'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:07 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:07 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:07 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:07 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:07 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa" returned: 0 in 0.537s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:07 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:07 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Deleted volume successfully. Sep 05 21:07:07 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa Sep 05 21:07:07 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-603c6343-bc1f-4678-bbd3-17624a02e082 tempest-ProjectReaderTests-1491894152 None] Lock "cinder-002659fb-be73-4ce0-8be4-0ca270838c2e-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:07 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.392s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:07 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:07:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ce97732a-ddbe-4cfb-85b2-75e937f18268 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-68d3b57f-b297-40d2-a045-adbdddc82170-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:07 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850.2a3a46b4-a553-407e-8949-0115d4be5efa" returned: 0 in 0.312s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-2a3a46b4-a553-407e-8949-0115d4be5efa" released by "_delete_snapshot" :: held 1.921s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-6a585e3c-99b4-4b75-9540-08cd98559850" released by "delete_snapshot" :: held 1.963s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (ab5bfcf8-0cfb-423e-84ba-b8e14b97eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57ecd25-ccc6-4fee-ad7f-9c18581199d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57ecd25-ccc6-4fee-ad7f-9c18581199d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408802072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:08Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f1f28e-8edb-4046-8d8a-4681eb9a0468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f1f28e-8edb-4046-8d8a-4681eb9a0468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9ae223-37f7-4160-8c9a-d4d1e0ad2c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9ae223-37f7-4160-8c9a-d4d1e0ad2c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb', 'volume_name': 'volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23495959-6060-4dc4-b72c-2ede8ca786ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23495959-6060-4dc4-b72c-2ede8ca786ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e96d0b-b5f2-45fb-8ef4-350e282d1ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Volume 464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb', 'volume_size': 1} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408802072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:08Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Creating volume 464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:08 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:08 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb 1073741824 Sep 05 21:07:08 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created reservations ['92eda636-a2de-4d88-b5b5-68f271acf3f1', '4a87988a-59d5-4dc9-b1f6-ebf2d35ae223', '3baac5d6-7bc8-49bc-b0de-cdbd0830e5de', 'd7fe9b33-c9df-42ac-9335-b645e11b9ea1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:08 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Delete snapshot completed successfully. Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f933b393-68d9-4400-90ef-cfc2b8740e00 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-2a3a46b4-a553-407e-8949-0115d4be5efa-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:08 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb 1073741824" returned: 0 in 0.549s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Flow 'volume_create_manager' (8ba115f0-8526-4779-a823-747ffb80aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7654f6-d5fa-4418-896d-7b0dec965555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7654f6-d5fa-4418-896d-7b0dec965555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971308665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3601acdc-0956-46eb-b1ee-a03cf7d95ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed926d736de40639867010eef3ce1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:09Z,use_quota=True,user_id='d7436dcdee254c81b0886b6b50f292ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d4470c-4c6f-4038-a735-40d2e27e0ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d4470c-4c6f-4038-a735-40d2e27e0ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ce05c-d5a1-4f58-ad6e-2f33446bdd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ce05c-d5a1-4f58-ad6e-2f33446bdd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3601acdc-0956-46eb-b1ee-a03cf7d95ba7', 'volume_name': 'volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05dea8f4-06bb-4755-bfad-c312aade1a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05dea8f4-06bb-4755-bfad-c312aade1a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0a39e0-1766-45c7-aa81-dc1d275a9589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:08 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Volume 3601acdc-0956-46eb-b1ee-a03cf7d95ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7', 'volume_size': 1} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:08 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb Sep 05 21:07:08 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:09 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" returned: 0 in 0.259s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971308665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3601acdc-0956-46eb-b1ee-a03cf7d95ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed926d736de40639867010eef3ce1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:09Z,use_quota=True,user_id='d7436dcdee254c81b0886b6b50f292ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Creating volume 3601acdc-0956-46eb-b1ee-a03cf7d95ba7 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:09 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e96d0b-b5f2-45fb-8ef4-350e282d1ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:09 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 1073741824 Sep 05 21:07:09 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b18dce-9bd6-4523-bbb0-eccd92555928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:09 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Volume volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb (464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb): created successfully Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b18dce-9bd6-4523-bbb0-eccd92555928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (ab5bfcf8-0cfb-423e-84ba-b8e14b97eb72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:09 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fa36e9fe-ff3c-44cc-8f2a-f5957ef11b4e tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-6a585e3c-99b4-4b75-9540-08cd98559850-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-6a585e3c-99b4-4b75-9540-08cd98559850-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Flow 'volume_create_manager' (f81f86b7-a5a2-49c7-85ff-7225d0fdc2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe5923d-b1e9-4aee-8f38-78ddcab7fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "cinder-quobyte-6a585e3c-99b4-4b75-9540-08cd98559850" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe5923d-b1e9-4aee-8f38-78ddcab7fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d292754e-1b6e-4cf0-8de0-504440cbf2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bb945a017647a0b4440e882223e383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:09Z,use_quota=True,user_id='305fca156286403ab5a426748873d13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2285b19-b2fb-4dc6-b7b9-581e8c8a96df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2285b19-b2fb-4dc6-b7b9-581e8c8a96df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2719d0-7532-42bd-980a-8bc3feb6750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2719d0-7532-42bd-980a-8bc3feb6750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd292754e-1b6e-4cf0-8de0-504440cbf2a8', 'volume_name': 'volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d164d15d-6df7-4f21-9928-55f0f5d1b033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d164d15d-6df7-4f21-9928-55f0f5d1b033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13367c9-912f-4117-a0aa-52d4ce961f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:09 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Volume d292754e-1b6e-4cf0-8de0-504440cbf2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8', 'volume_size': 1} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-6a585e3c-99b4-4b75-9540-08cd98559850" acquired by "delete_volume" :: waited 0.059s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee32919-7bb9-4972-8fd3-6b34a2ee243f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:09 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 1073741824" returned: 0 in 0.486s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:09 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 Sep 05 21:07:09 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:09 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 Sep 05 21:07:09 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:09 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850" returned: 0 in 0.357s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:09 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850 Sep 05 21:07:09 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:09 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7" returned: 0 in 0.245s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d292754e-1b6e-4cf0-8de0-504440cbf2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bb945a017647a0b4440e882223e383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:09Z,use_quota=True,user_id='305fca156286403ab5a426748873d13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Creating volume d292754e-1b6e-4cf0-8de0-504440cbf2a8 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:09 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0a39e0-1766-45c7-aa81-dc1d275a9589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:09 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 1073741824 Sep 05 21:07:09 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9536c2d0-c457-487d-ad93-be1a6e636cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:10 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Volume volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 (3601acdc-0956-46eb-b1ee-a03cf7d95ba7): created successfully Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9536c2d0-c457-487d-ad93-be1a6e636cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Flow 'volume_create_manager' (8ba115f0-8526-4779-a823-747ffb80aa10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:10 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c7bcc6eb-2fd9-4153-8eda-9824d98fee88 tempest-ProjectReaderTests-1491894152 None] Created volume successfully. Sep 05 21:07:10 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6a585e3c-99b4-4b75-9540-08cd98559850" returned: 0 in 0.274s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-quobyte-6a585e3c-99b4-4b75-9540-08cd98559850" released by "delete_volume" :: held 0.691s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Created reservations ['a8397afc-b115-4bf5-93f1-dc587ea3db31', '60530256-41b6-44fe-9aa0-09c089ca7442', 'f1a21c5d-08bd-4743-954b-cc32a8cdc896', '528a6800-17e5-47f5-8c5a-0f5b2858ad2a'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:10 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:10 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:10 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 1073741824" returned: 0 in 0.505s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:10 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 Sep 05 21:07:10 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:10 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.265s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:10 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Deleted volume successfully. Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e432cf03-cba2-4067-b59c-2f2213228e04 tempest-CreateVolumesFromSnapshotTest-1520528385 None] Lock "cinder-6a585e3c-99b4-4b75-9540-08cd98559850-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:10 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8" returned: 0 in 0.260s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.438s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13367c9-912f-4117-a0aa-52d4ce961f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe98054d-f19a-4033-8fcb-7df870513570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot e1b9ea45-ba4a-4018-bff2-0b82208a8a44 of volume 464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:10 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Volume volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 (d292754e-1b6e-4cf0-8de0-504440cbf2a8): created successfully Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe98054d-f19a-4033-8fcb-7df870513570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Flow 'volume_create_manager' (f81f86b7-a5a2-49c7-85ff-7225d0fdc2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b394503-915f-4a25-8956-f08d7d48aa57]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:10 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-89a81ee6-dcc7-431b-b31f-892bd0c27e6d tempest-CinderUnicodeTest-726092361 None] Created volume successfully. Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "cinder-3601acdc-0956-46eb-b1ee-a03cf7d95ba7-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Lock "cinder-3601acdc-0956-46eb-b1ee-a03cf7d95ba7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:10 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "cinder-quobyte-3601acdc-0956-46eb-b1ee-a03cf7d95ba7" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:10 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb Sep 05 21:07:10 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Lock "cinder-quobyte-3601acdc-0956-46eb-b1ee-a03cf7d95ba7" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[828590cd-87d4-4a4f-86bd-f4b6ece3aae1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:11 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 Sep 05 21:07:11 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:11 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" returned: 0 in 0.416s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:11 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 1G Sep 05 21:07:11 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7" returned: 0 in 0.416s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:11 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:11 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7 Sep 05 21:07:11 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:11 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 1G" returned: 0 in 0.493s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:11 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3601acdc-0956-46eb-b1ee-a03cf7d95ba7" returned: 0 in 0.333s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:11 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 Sep 05 21:07:11 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Lock "cinder-quobyte-3601acdc-0956-46eb-b1ee-a03cf7d95ba7" released by "delete_volume" :: held 0.795s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Created reservations ['65a5a0b0-e140-427e-ada6-62af428c74ea', 'c68b31db-751b-4895-8581-a1763fe582b7', '0baed591-0047-405a-b04b-4f09f6b8f1ad', '92d1c122-4c38-481f-bb5e-7c90291fd45a'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:11 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:12 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:12 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:12 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44" returned: 0 in 0.473s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:12 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 is being set with open permissions: ugo+rw Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:12 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 Sep 05 21:07:12 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Flow 'volume_create_manager' (6bd02730-ec10-4c8d-a618-0fd424d1bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619448f6-2ebd-490a-a557-821fde09a578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619448f6-2ebd-490a-a557-821fde09a578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1192736527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a09379-a71d-4120-9f63-290e0ce63f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bb945a017647a0b4440e882223e383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:12Z,use_quota=True,user_id='305fca156286403ab5a426748873d13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fafcfc-9602-4f1c-b1be-784a9eca040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fafcfc-9602-4f1c-b1be-784a9eca040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ce5c8d-aacf-40e8-9ccd-a1226c560e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ce5c8d-aacf-40e8-9ccd-a1226c560e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a09379-a71d-4120-9f63-290e0ce63f38', 'volume_name': 'volume-08a09379-a71d-4120-9f63-290e0ce63f38', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec3495b-f2de-4985-9b46-c95a810c079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec3495b-f2de-4985-9b46-c95a810c079a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601ed77f-c7fd-41fa-9ebc-1ba48a9dc479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:12 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Volume 08a09379-a71d-4120-9f63-290e0ce63f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a09379-a71d-4120-9f63-290e0ce63f38', 'volume_size': 1} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:12 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.403s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:12 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Deleted volume successfully. Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c78c706a-796a-4240-afaa-19af376a8702 tempest-ProjectReaderTests-1491894152 None] Lock "cinder-3601acdc-0956-46eb-b1ee-a03cf7d95ba7-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:12 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44" returned: 0 in 0.368s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:12 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.info Sep 05 21:07:12 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:12 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.info" returned: 0 in 0.260s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:12 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.info is being set with open permissions: ugo+rw Sep 05 21:07:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:12 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.info Sep 05 21:07:12 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:13 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.info" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1192736527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a09379-a71d-4120-9f63-290e0ce63f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bb945a017647a0b4440e882223e383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:12Z,use_quota=True,user_id='305fca156286403ab5a426748873d13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Creating volume 08a09379-a71d-4120-9f63-290e0ce63f38 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:13 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:13 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 1073741824 Sep 05 21:07:13 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:13 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d5aa626b-b465-4d49-8e0d-ffe74ec35616 tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-e1b9ea45-ba4a-4018-bff2-0b82208a8a44-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Lock "cinder-e1b9ea45-ba4a-4018-bff2-0b82208a8a44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-e1b9ea45-ba4a-4018-bff2-0b82208a8a44" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-e1b9ea45-ba4a-4018-bff2-0b82208a8a44" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot e1b9ea45-ba4a-4018-bff2-0b82208a8a44 of volume 464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[831a40a2-e15e-4289-a399-bca24b8971f8]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:13 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 1073741824" returned: 0 in 0.569s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:13 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 Sep 05 21:07:13 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:13 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 Sep 05 21:07:13 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:14 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44" returned: 0 in 0.476s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:14 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38" returned: 0 in 0.318s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d7585f-0b7f-4832-9cea-0743518f1aee]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601ed77f-c7fd-41fa-9ebc-1ba48a9dc479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a09379-a71d-4120-9f63-290e0ce63f38', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f13d5f-9779-4ec8-9d42-4bde20745362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:14 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Volume volume-08a09379-a71d-4120-9f63-290e0ce63f38 (08a09379-a71d-4120-9f63-290e0ce63f38): created successfully Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f13d5f-9779-4ec8-9d42-4bde20745362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Flow 'volume_create_manager' (6bd02730-ec10-4c8d-a618-0fd424d1bfef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:14 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3a20bbe3-a8ed-45fb-b7a3-92d97b591e35 tempest-CinderUnicodeTest-726092361 None] Created volume successfully. Sep 05 21:07:14 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb Sep 05 21:07:14 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4ba1bcdc-c1c8-465c-a555-12ac414b59ae tempest-ProjectAdminTests-1311897759 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.672607421875, 'free_capacity_gb': 1773.672607421875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87802) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 21:07:14 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" returned: 0 in 0.491s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:14 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 Sep 05 21:07:14 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:15 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44" returned: 0 in 0.388s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:15 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44 Sep 05 21:07:15 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:15 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb.e1b9ea45-ba4a-4018-bff2-0b82208a8a44" returned: 0 in 0.271s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-e1b9ea45-ba4a-4018-bff2-0b82208a8a44" released by "_delete_snapshot" :: held 1.766s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" released by "delete_snapshot" :: held 1.806s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Created reservations ['0528af0a-4e2f-4498-ab53-75c836a94fd1', '42f4efcf-f6c8-4ef5-b6d7-3a119ba87eaf', 'ae88b4df-62a9-45d9-bd34-6cd04b727c1c', 'a631405a-c408-4ae6-ad32-59bc5490e056'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:15 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f313276e-005e-4577-8862-616800472a4b tempest-ProjectMemberTests-1941667694 None] Lock "cinder-e1b9ea45-ba4a-4018-bff2-0b82208a8a44-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Creating offline snapshot 445bcaaa-eb73-4b90-9738-9c60156b901d of volume 08a09379-a71d-4120-9f63-290e0ce63f38 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc2960e-0acd-42e7-ad93-e516496ff0cf]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:15 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 Sep 05 21:07:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:15 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d32f66a-9475-4f29-86c8-fdd3deda4d89]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:16 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb Sep 05 21:07:16 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:16 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38" returned: 0 in 0.505s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:16 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d 1G Sep 05 21:07:16 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:16 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" returned: 0 in 0.496s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:16 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb Sep 05 21:07:16 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:16 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" returned: 0 in 0.276s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:16 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d 1G" returned: 0 in 0.522s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a09379-a71d-4120-9f63-290e0ce63f38 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb" released by "delete_volume" :: held 0.868s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:16 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a09379-a71d-4120-9f63-290e0ce63f38 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d Sep 05 21:07:16 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Created reservations ['0f23517d-73fe-42c3-9be2-ab0738086b1b', '2828567a-0316-443a-a771-236da7c2d28b', '59f4745f-b2ad-4d49-98a8-d6d7af50340c', 'c3b775ae-127b-4d9c-b46d-432a7d9dfb7c'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:17 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:17 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:17 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a09379-a71d-4120-9f63-290e0ce63f38 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d" returned: 0 in 0.460s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:17 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d is being set with open permissions: ugo+rw Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:17 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d Sep 05 21:07:17 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:17 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Flow 'volume_create_manager' (e3b46527-609b-4b21-ac35-3f7a7389989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c929549f-b086-4ab8-88b3-43303c13dfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.369s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:17 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c929549f-b086-4ab8-88b3-43303c13dfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-26499725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3903252-eae0-49e4-a85c-8950237c1dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735b241fe0040f585745bd39c50be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:17Z,use_quota=True,user_id='a649c677ae5842a6b02137352d7b7797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbef8af-9403-4f84-b76f-a38dd4a060c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbef8af-9403-4f84-b76f-a38dd4a060c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a29df6-a5b1-4ad8-976e-d335fa1c4bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a29df6-a5b1-4ad8-976e-d335fa1c4bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3903252-eae0-49e4-a85c-8950237c1dfe', 'volume_name': 'volume-a3903252-eae0-49e4-a85c-8950237c1dfe', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e676e020-e6d5-4295-83d7-70bb0c6150ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e676e020-e6d5-4295-83d7-70bb0c6150ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0efa9f-a5e5-4cfb-93b8-0414852b4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Volume a3903252-eae0-49e4-a85c-8950237c1dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3903252-eae0-49e4-a85c-8950237c1dfe', 'volume_size': 1} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8f348bf1-7c02-4e1c-8c38-ea949d4bf8e7 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-464f3ecf-bba0-4a4c-a0c5-3f83fdc2a2eb-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:17 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d" returned: 0 in 0.354s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:17 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.info Sep 05 21:07:17 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (afe8e9ba-c326-4b4a-a132-79e0f913dbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdef62c-dcba-491c-9062-c30db07d5732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdef62c-dcba-491c-9062-c30db07d5732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790035180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16cfd8c-c047-4543-a976-a1ec13b65a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:18Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdaf73c-5e3c-42e2-90cf-4139bf140af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdaf73c-5e3c-42e2-90cf-4139bf140af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c592e9e0-95bc-4cbf-a9b9-3c2a403df670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c592e9e0-95bc-4cbf-a9b9-3c2a403df670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e16cfd8c-c047-4543-a976-a1ec13b65a58', 'volume_name': 'volume-e16cfd8c-c047-4543-a976-a1ec13b65a58', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6106a75-605c-4f7e-aeb4-2f046a07450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6106a75-605c-4f7e-aeb4-2f046a07450e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f78cf8-d066-4210-af43-e85a9eaaa71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:17 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Volume e16cfd8c-c047-4543-a976-a1ec13b65a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e16cfd8c-c047-4543-a976-a1ec13b65a58', 'volume_size': 1} Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:17 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.info" returned: 0 in 0.261s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:17 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.info is being set with open permissions: ugo+rw Sep 05 21:07:17 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:17 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.info Sep 05 21:07:17 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:18 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.info" returned: 0 in 0.247s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-26499725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3903252-eae0-49e4-a85c-8950237c1dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735b241fe0040f585745bd39c50be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:17Z,use_quota=True,user_id='a649c677ae5842a6b02137352d7b7797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Creating volume a3903252-eae0-49e4-a85c-8950237c1dfe {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:18 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:18 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe 1073741824 Sep 05 21:07:18 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:18 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e8be896f-3218-4794-b2e3-42a1f47c067e tempest-CinderUnicodeTest-726092361 None] Create snapshot completed successfully Sep 05 21:07:18 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe 1073741824" returned: 0 in 0.480s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:18 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe Sep 05 21:07:18 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Acquiring lock "cinder-445bcaaa-eb73-4b90-9738-9c60156b901d-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-445bcaaa-eb73-4b90-9738-9c60156b901d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Acquiring lock "cinder-quobyte-08a09379-a71d-4120-9f63-290e0ce63f38" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-quobyte-08a09379-a71d-4120-9f63-290e0ce63f38" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Acquiring lock "cinder-quobyte-445bcaaa-eb73-4b90-9738-9c60156b901d" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-quobyte-445bcaaa-eb73-4b90-9738-9c60156b901d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:18 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:18 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Deleting offline snapshot 445bcaaa-eb73-4b90-9738-9c60156b901d of volume 08a09379-a71d-4120-9f63-290e0ce63f38 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] snapshot_file for this snap is: volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe" returned: 0 in 0.290s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790035180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16cfd8c-c047-4543-a976-a1ec13b65a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:18Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Creating volume e16cfd8c-c047-4543-a976-a1ec13b65a58 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:19 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b670e866-094e-44ca-9aa2-c50c41f638d0]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:19 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 1073741824 Sep 05 21:07:19 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0efa9f-a5e5-4cfb-93b8-0414852b4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3903252-eae0-49e4-a85c-8950237c1dfe', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444db4cf-cf05-4e8f-9703-2f8e5679b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:19 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Volume volume-a3903252-eae0-49e4-a85c-8950237c1dfe (a3903252-eae0-49e4-a85c-8950237c1dfe): created successfully Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444db4cf-cf05-4e8f-9703-2f8e5679b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Flow 'volume_create_manager' (e3b46527-609b-4b21-ac35-3f7a7389989a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:19 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f9761484-46c4-4ed9-ab14-4e3a2325a60d tempest-ProjectReaderTests-2011502081 None] Created volume successfully. Sep 05 21:07:19 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d Sep 05 21:07:19 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (c251d652-b3c0-4f5e-8a2d-2b412f8abacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bcd1c50-9075-44e0-bf2a-01328b278c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bcd1c50-9075-44e0-bf2a-01328b278c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837188870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642ba98a-36cc-4946-97a3-3fed4e1fe6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:19Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd238804-29d8-41f8-b175-efab5f615e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd238804-29d8-41f8-b175-efab5f615e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ded479-2c65-4fb5-a025-15b7abbab43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ded479-2c65-4fb5-a025-15b7abbab43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642ba98a-36cc-4946-97a3-3fed4e1fe6a1', 'volume_name': 'volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215df5d1-d0aa-4aa0-a693-9a19fead2301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215df5d1-d0aa-4aa0-a693-9a19fead2301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f3b471-4056-4fdb-bf0c-14ead670da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:19 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Volume 642ba98a-36cc-4946-97a3-3fed4e1fe6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1', 'volume_size': 1} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:19 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d" returned: 0 in 0.456s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08a09379-a71d-4120-9f63-290e0ce63f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[63baf830-7ff2-41ba-9cb9-694b223fce14]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "cinder-a3903252-eae0-49e4-a85c-8950237c1dfe-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-a3903252-eae0-49e4-a85c-8950237c1dfe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:19 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 1073741824" returned: 0 in 0.569s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "cinder-quobyte-a3903252-eae0-49e4-a85c-8950237c1dfe" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-quobyte-a3903252-eae0-49e4-a85c-8950237c1dfe" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:19 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 Sep 05 21:07:19 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e4a04c-3bf4-468a-8228-6975d738678f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:19 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 Sep 05 21:07:19 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:19 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe Sep 05 21:07:19 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:19 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58" returned: 0 in 0.244s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837188870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642ba98a-36cc-4946-97a3-3fed4e1fe6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:19Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Creating volume 642ba98a-36cc-4946-97a3-3fed4e1fe6a1 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:19 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:19 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38" returned: 0 in 0.418s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:19 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 1073741824 Sep 05 21:07:19 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f78cf8-d066-4210-af43-e85a9eaaa71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16cfd8c-c047-4543-a976-a1ec13b65a58', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:19 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d Sep 05 21:07:19 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:19 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9354af62-238e-4620-b01d-d91ff869724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:19 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Volume volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 (e16cfd8c-c047-4543-a976-a1ec13b65a58): created successfully Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9354af62-238e-4620-b01d-d91ff869724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (afe8e9ba-c326-4b4a-a132-79e0f913dbc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6352c632-dc85-47d7-a18a-534773292875 tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:07:20 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe" returned: 0 in 0.408s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:20 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe Sep 05 21:07:20 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:20 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d" returned: 0 in 0.374s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:20 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d Sep 05 21:07:20 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:20 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-a3903252-eae0-49e4-a85c-8950237c1dfe" returned: 0 in 0.283s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-quobyte-a3903252-eae0-49e4-a85c-8950237c1dfe" released by "delete_volume" :: held 0.738s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:20 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 1073741824" returned: 0 in 0.482s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Created reservations ['a0ddf58b-7dbb-43da-9330-2d186a9ad184', '24c82479-4c7c-4eaf-bf9e-85f4afab2d2e', 'fc16b165-e8b3-4ca8-9cc1-9847575f5dba', 'af6857cc-eae2-4b47-9d8e-9a7e95ffc8cd'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:20 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 Sep 05 21:07:20 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:20 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:20 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:20 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38.445bcaaa-eb73-4b90-9738-9c60156b901d" returned: 0 in 0.265s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-quobyte-445bcaaa-eb73-4b90-9738-9c60156b901d" released by "_delete_snapshot" :: held 1.651s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-quobyte-08a09379-a71d-4120-9f63-290e0ce63f38" released by "delete_snapshot" :: held 1.679s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Created reservations ['5ab72b6f-a4d3-400f-92ae-2d4471a7dc04', 'e1147182-b415-4fac-b789-84a99eb10fcf', 'd650fb38-0c33-438a-ac55-97a2e28e8151', 'cb17ef68-fc42-4198-97cb-d8005d47bc32'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:20 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" returned: 0 in 0.294s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f3b471-4056-4fdb-bf0c-14ead670da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8238d5-60f3-4ce3-b7e6-8104973ab064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:20 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:20 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Volume volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 (642ba98a-36cc-4946-97a3-3fed4e1fe6a1): created successfully Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8238d5-60f3-4ce3-b7e6-8104973ab064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (c251d652-b3c0-4f5e-8a2d-2b412f8abacd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.277s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Deleted volume successfully. Sep 05 21:07:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d6917aa1-0912-43ca-847b-781e02727561 tempest-ProjectReaderTests-78117735 None] Created volume successfully. Sep 05 21:07:20 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Delete snapshot completed successfully. Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f745bcca-d408-480d-9048-8c0e739725b7 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-445bcaaa-eb73-4b90-9738-9c60156b901d-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:20 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0ca1b05a-26d4-4c4c-a404-66337ef0c4d7 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-a3903252-eae0-49e4-a85c-8950237c1dfe-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot 1f0978ca-40a9-43e9-bae7-967f000b2d1d of volume e16cfd8c-c047-4543-a976-a1ec13b65a58 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Acquiring lock "cinder-08a09379-a71d-4120-9f63-290e0ce63f38-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c2c73-95db-425e-a4d8-450a05664d93]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Lock "cinder-08a09379-a71d-4120-9f63-290e0ce63f38-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Acquiring lock "cinder-quobyte-08a09379-a71d-4120-9f63-290e0ce63f38" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Lock "cinder-quobyte-08a09379-a71d-4120-9f63-290e0ce63f38" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:21 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 Sep 05 21:07:21 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a91e0-ec9f-4b8a-a429-7da05c288ab3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Flow 'volume_create_manager' (c96c2ed7-98ab-4889-b35d-193273689dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fdcdbe4-fc63-46e2-877d-8716b8f1a2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fdcdbe4-fc63-46e2-877d-8716b8f1a2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696963506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bb0055-06a9-4de3-bd84-39401966266c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735b241fe0040f585745bd39c50be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:21Z,use_quota=True,user_id='a649c677ae5842a6b02137352d7b7797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2473e594-bb46-46ff-bc32-96ff65d9bd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2473e594-bb46-46ff-bc32-96ff65d9bd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2540ec33-e715-4f49-8705-19e3018d0efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2540ec33-e715-4f49-8705-19e3018d0efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bb0055-06a9-4de3-bd84-39401966266c', 'volume_name': 'volume-b4bb0055-06a9-4de3-bd84-39401966266c', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffceb1c-9c36-49f9-b49f-55f844a620d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:21 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 Sep 05 21:07:21 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffceb1c-9c36-49f9-b49f-55f844a620d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc0336e-fe94-45ed-b52c-f492b1e5a504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:21 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Volume b4bb0055-06a9-4de3-bd84-39401966266c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bb0055-06a9-4de3-bd84-39401966266c', 'volume_size': 1} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:21 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58" returned: 0 in 0.440s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:21 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d 1G Sep 05 21:07:21 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:21 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38" returned: 0 in 0.427s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:21 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38 Sep 05 21:07:21 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:21 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d 1G" returned: 0 in 0.378s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:21 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:21 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d Sep 05 21:07:21 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:21 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-08a09379-a71d-4120-9f63-290e0ce63f38" returned: 0 in 0.258s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Lock "cinder-quobyte-08a09379-a71d-4120-9f63-290e0ce63f38" released by "delete_volume" :: held 0.758s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=323,cinder:SELECT=256,cinder:DELETE=32,cinder:INSERT=93 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=248,cinder:UPDATE=354,cinder:INSERT=85,cinder:DELETE=29 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Created reservations ['d39abfa8-f5a6-4bce-913b-0fa063d90ee9', '0110049e-c1e7-4c2a-b223-dfdf504e95c0', '3f60736f-695f-40a1-888e-0a82c64ee354', 'cdfa373d-5808-42e9-a121-4d02e2f19bad'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:22 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:22 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:22 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Acquiring lock "cinder-d292754e-1b6e-4cf0-8de0-504440cbf2a8-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d" returned: 0 in 0.348s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:22 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d is being set with open permissions: ugo+rw Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-d292754e-1b6e-4cf0-8de0-504440cbf2a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:22 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d Sep 05 21:07:22 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Acquiring lock "cinder-quobyte-d292754e-1b6e-4cf0-8de0-504440cbf2a8" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-quobyte-d292754e-1b6e-4cf0-8de0-504440cbf2a8" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce76dbf-5316-4dff-b570-8cdfd6943b85]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:22 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.284s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:22 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Deleted volume successfully. Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d12a615f-b218-4762-b3af-94c94466a80b tempest-CinderUnicodeTest-726092361 None] Lock "cinder-08a09379-a71d-4120-9f63-290e0ce63f38-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:22 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 Sep 05 21:07:22 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:22 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d" returned: 0 in 0.277s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:22 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.info Sep 05 21:07:22 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:22 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8" returned: 0 in 0.370s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:22 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8 Sep 05 21:07:22 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:22 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.info" returned: 0 in 0.249s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:22 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.info is being set with open permissions: ugo+rw Sep 05 21:07:22 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:22 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.info Sep 05 21:07:22 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:23 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-d292754e-1b6e-4cf0-8de0-504440cbf2a8" returned: 0 in 0.257s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-quobyte-d292754e-1b6e-4cf0-8de0-504440cbf2a8" released by "delete_volume" :: held 0.673s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:23 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.info" returned: 0 in 0.248s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696963506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bb0055-06a9-4de3-bd84-39401966266c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735b241fe0040f585745bd39c50be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:21Z,use_quota=True,user_id='a649c677ae5842a6b02137352d7b7797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Creating volume b4bb0055-06a9-4de3-bd84-39401966266c {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:23 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:23 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c 1073741824 Sep 05 21:07:23 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Created reservations ['b0b63c5f-6cac-4892-a211-a8be65e6d5ec', 'c37da3e5-7c4a-4ff5-a886-f4748bd16018', '5618667e-41a3-49bd-8622-08b7604c4232', '0ce12b4d-3fc5-4c55-90a7-f69c3318a38b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-136de281-fd4a-427a-8c97-bdd5cdc122bf tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:23 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:23 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:23 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.264s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Deleted volume successfully. Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-c3403cb3-25b5-4a3c-b6d8-1e50f9ef9bc6 tempest-CinderUnicodeTest-726092361 None] Lock "cinder-d292754e-1b6e-4cf0-8de0-504440cbf2a8-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:23 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c 1073741824" returned: 0 in 0.451s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:23 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c Sep 05 21:07:23 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:23 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c" returned: 0 in 0.250s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.307s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc0336e-fe94-45ed-b52c-f492b1e5a504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bb0055-06a9-4de3-bd84-39401966266c', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b0b465-5e59-4895-a483-3f67a3b79676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Creating offline snapshot bb160321-ad03-486a-b200-f67b23dfc70a of volume 642ba98a-36cc-4946-97a3-3fed4e1fe6a1 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:23 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Volume volume-b4bb0055-06a9-4de3-bd84-39401966266c (b4bb0055-06a9-4de3-bd84-39401966266c): created successfully Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b0b465-5e59-4895-a483-3f67a3b79676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Flow 'volume_create_manager' (c96c2ed7-98ab-4889-b35d-193273689dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18dc85a-6cc8-481a-8c84-c190f388a6f3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:23 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:23 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3a143bc3-fcc5-4191-a7fe-fb9fe7ed6627 tempest-ProjectReaderTests-2011502081 None] Created volume successfully. Sep 05 21:07:24 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 Sep 05 21:07:24 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-1f0978ca-40a9-43e9-bae7-967f000b2d1d-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-1f0978ca-40a9-43e9-bae7-967f000b2d1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-e16cfd8c-c047-4543-a976-a1ec13b65a58" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-e16cfd8c-c047-4543-a976-a1ec13b65a58" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-1f0978ca-40a9-43e9-bae7-967f000b2d1d" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-1f0978ca-40a9-43e9-bae7-967f000b2d1d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot 1f0978ca-40a9-43e9-bae7-967f000b2d1d of volume e16cfd8c-c047-4543-a976-a1ec13b65a58 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:24 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" returned: 0 in 0.433s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d549f-c9d8-4baf-88d1-333eed7e3fd1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:24 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a 1G Sep 05 21:07:24 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:24 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d Sep 05 21:07:24 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Acquiring lock "cinder-b4bb0055-06a9-4de3-bd84-39401966266c-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Lock "cinder-b4bb0055-06a9-4de3-bd84-39401966266c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Acquiring lock "cinder-quobyte-b4bb0055-06a9-4de3-bd84-39401966266c" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Lock "cinder-quobyte-b4bb0055-06a9-4de3-bd84-39401966266c" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b11cedc-fc8e-49b5-9aa9-4512955aea01]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:24 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c Sep 05 21:07:24 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:24 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d" returned: 0 in 0.469s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e16cfd8c-c047-4543-a976-a1ec13b65a58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd35b56-8290-44eb-9115-d83eace71ddf]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:24 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a 1G" returned: 0 in 0.565s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:24 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:24 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a Sep 05 21:07:24 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:25 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 Sep 05 21:07:25 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:25 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c" returned: 0 in 0.490s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:25 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c Sep 05 21:07:25 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:25 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a" returned: 0 in 0.348s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:25 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a is being set with open permissions: ugo+rw Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:25 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:25 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a Sep 05 21:07:25 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58" returned: 0 in 0.422s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:25 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d Sep 05 21:07:25 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:25 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-b4bb0055-06a9-4de3-bd84-39401966266c" returned: 0 in 0.297s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Lock "cinder-quobyte-b4bb0055-06a9-4de3-bd84-39401966266c" released by "delete_volume" :: held 0.847s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Created reservations ['7a34463b-3e02-4a63-9c7b-503653e09c5f', 'b92e02a8-7ab9-46d8-a52d-a7df29fc941b', 'a00be372-494d-4eb4-b893-3edd9e92c2af', 'eca24d71-bad0-41a4-923e-f6cf5d5171a9'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:25 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a" returned: 0 in 0.293s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:25 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.info Sep 05 21:07:25 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:25 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:25 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:25 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d" returned: 0 in 0.498s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:25 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:25 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d Sep 05 21:07:25 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:26 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:26 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.info" returned: 0 in 0.370s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:26 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.info is being set with open permissions: ugo+rw Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.318s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Deleted volume successfully. Sep 05 21:07:26 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.info Sep 05 21:07:26 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7ba61eb1-dede-44e0-94f3-2902414b347a tempest-ProjectReaderTests-2011502081 None] Lock "cinder-b4bb0055-06a9-4de3-bd84-39401966266c-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:26 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58.1f0978ca-40a9-43e9-bae7-967f000b2d1d" returned: 0 in 0.385s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-1f0978ca-40a9-43e9-bae7-967f000b2d1d" released by "_delete_snapshot" :: held 1.916s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-e16cfd8c-c047-4543-a976-a1ec13b65a58" released by "delete_snapshot" :: held 1.955s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:26 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.info" returned: 0 in 0.344s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Created reservations ['ea9afc81-eb0a-4199-9a6a-eb46a064462e', '34188da6-2609-489c-b398-7f7f4159f35a', '745a4307-1849-43d7-bba2-1ed8df115178', '2023f24a-c202-4284-b06a-4f5f98d32b52'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0983188a-cbf4-4a66-9661-2604bc605e93 tempest-ProjectReaderTests-78117735 None] Create snapshot completed successfully Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Flow 'volume_create_manager' (0fd28961-52b2-4b6a-893e-d17cd641e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b296f513-d3e4-4fe8-81d1-3f96c3a21f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b296f513-d3e4-4fe8-81d1-3f96c3a21f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499214982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ae7834-a1ee-4db8-96ea-7829ed34717b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735b241fe0040f585745bd39c50be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:26Z,use_quota=True,user_id='a649c677ae5842a6b02137352d7b7797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb6b60e-6332-4c7f-a189-0d4a8ca92f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb6b60e-6332-4c7f-a189-0d4a8ca92f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a4887e-51dd-4bc2-82b4-611aa4a24601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a4887e-51dd-4bc2-82b4-611aa4a24601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ae7834-a1ee-4db8-96ea-7829ed34717b', 'volume_name': 'volume-94ae7834-a1ee-4db8-96ea-7829ed34717b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4c3b63-5280-46a5-a704-2b709aa69d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4c3b63-5280-46a5-a704-2b709aa69d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970390e1-1981-4853-a912-ab65cc0ce54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:26 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Volume 94ae7834-a1ee-4db8-96ea-7829ed34717b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ae7834-a1ee-4db8-96ea-7829ed34717b', 'volume_size': 1} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499214982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ae7834-a1ee-4db8-96ea-7829ed34717b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735b241fe0040f585745bd39c50be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:26Z,use_quota=True,user_id='a649c677ae5842a6b02137352d7b7797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Creating volume 94ae7834-a1ee-4db8-96ea-7829ed34717b {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:26 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:26 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:07:26 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-d878f266-0f02-4938-9b5f-38fe63b60fb4 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-1f0978ca-40a9-43e9-bae7-967f000b2d1d-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:26 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b 1073741824 Sep 05 21:07:26 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:26 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b 1073741824" returned: 0 in 0.463s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:27 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b Sep 05 21:07:27 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-bb160321-ad03-486a-b200-f67b23dfc70a-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-bb160321-ad03-486a-b200-f67b23dfc70a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-bb160321-ad03-486a-b200-f67b23dfc70a" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-bb160321-ad03-486a-b200-f67b23dfc70a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Deleting offline snapshot bb160321-ad03-486a-b200-f67b23dfc70a of volume 642ba98a-36cc-4946-97a3-3fed4e1fe6a1 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] snapshot_file for this snap is: volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[05365698-9cc2-4ecc-a8bf-a0957ef8c184]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:27 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b" returned: 0 in 0.290s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970390e1-1981-4853-a912-ab65cc0ce54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ae7834-a1ee-4db8-96ea-7829ed34717b', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bbf8df-4d3f-4ee7-9619-b8211fb6f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:27 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Volume volume-94ae7834-a1ee-4db8-96ea-7829ed34717b (94ae7834-a1ee-4db8-96ea-7829ed34717b): created successfully Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bbf8df-4d3f-4ee7-9619-b8211fb6f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Flow 'volume_create_manager' (0fd28961-52b2-4b6a-893e-d17cd641e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:27 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a Sep 05 21:07:27 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-44763a7e-2c82-473b-82de-e8ca9210d9b5 tempest-ProjectReaderTests-2011502081 None] Created volume successfully. Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-e16cfd8c-c047-4543-a976-a1ec13b65a58-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Lock "cinder-e16cfd8c-c047-4543-a976-a1ec13b65a58-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-e16cfd8c-c047-4543-a976-a1ec13b65a58" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-e16cfd8c-c047-4543-a976-a1ec13b65a58" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17023e4-a81d-43a3-b148-0262520ebc64]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:27 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a" returned: 0 in 0.428s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddd8ada-7b75-4c2e-be9c-312f043c3334]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:27 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 Sep 05 21:07:27 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:27 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 Sep 05 21:07:27 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:28 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58" returned: 0 in 0.387s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:28 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58 Sep 05 21:07:28 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:28 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" returned: 0 in 0.421s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:28 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a Sep 05 21:07:28 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:28 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-e16cfd8c-c047-4543-a976-a1ec13b65a58" returned: 0 in 0.259s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-e16cfd8c-c047-4543-a976-a1ec13b65a58" released by "delete_volume" :: held 0.713s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Created reservations ['43acf5b7-f006-454e-8768-84136f11020a', 'b12f651a-a8c9-4f15-83fd-b192d0584121', 'bdd21e13-a26b-4960-bad8-00abdcb76d24', 'e361aaf3-9c6c-4bbf-846e-769750ab3403'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:28 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:28 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:28 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "cinder-94ae7834-a1ee-4db8-96ea-7829ed34717b-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a" returned: 0 in 0.448s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-94ae7834-a1ee-4db8-96ea-7829ed34717b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:28 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a Sep 05 21:07:28 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "cinder-quobyte-94ae7834-a1ee-4db8-96ea-7829ed34717b" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-quobyte-94ae7834-a1ee-4db8-96ea-7829ed34717b" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:28 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.325s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:28 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c7d312-acd2-4f1d-b187-b6c68cec90a5]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-0182ab2c-0969-4c85-b7d9-48aecb58953c tempest-ProjectMemberTests-1941667694 None] Lock "cinder-e16cfd8c-c047-4543-a976-a1ec13b65a58-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:28 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b Sep 05 21:07:28 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:28 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1.bb160321-ad03-486a-b200-f67b23dfc70a" returned: 0 in 0.383s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-bb160321-ad03-486a-b200-f67b23dfc70a" released by "_delete_snapshot" :: held 1.802s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" released by "delete_snapshot" :: held 1.834s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Created reservations ['6a62d9d3-9e4f-499b-a7bf-42fff5da3289', '4bfa10ff-371d-4a51-ba38-757c5bf47f0b', '4161b57a-988e-49bd-a2ec-e552c310b504', 'cc0afe9d-1d9c-400b-8251-684131250c74'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Delete snapshot completed successfully. Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-ab28d518-3431-47f8-8e35-fa4d2871a7c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-bb160321-ad03-486a-b200-f67b23dfc70a-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:29 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b" returned: 0 in 0.500s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:29 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b Sep 05 21:07:29 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (fdcf7b6d-9c03-4530-8b60-37e1c29f21ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a983708-f4d7-4d8b-98d4-71119579be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a983708-f4d7-4d8b-98d4-71119579be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047079203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74dce488-c2dc-4bdc-be66-f44298f819de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:29Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937a6b7d-24bd-4381-a477-2214c4cd5c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937a6b7d-24bd-4381-a477-2214c4cd5c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a55c93-d13f-4bb5-93ff-e171671d683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a55c93-d13f-4bb5-93ff-e171671d683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74dce488-c2dc-4bdc-be66-f44298f819de', 'volume_name': 'volume-74dce488-c2dc-4bdc-be66-f44298f819de', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb73fdc-d64f-4881-8b88-47c937b25705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb73fdc-d64f-4881-8b88-47c937b25705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9b24d0-97a5-4d8f-beba-d46b9b0b5637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:29 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Volume 74dce488-c2dc-4bdc-be66-f44298f819de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74dce488-c2dc-4bdc-be66-f44298f819de', 'volume_size': 1} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047079203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74dce488-c2dc-4bdc-be66-f44298f819de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:29Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Creating volume 74dce488-c2dc-4bdc-be66-f44298f819de {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:29 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-642ba98a-36cc-4946-97a3-3fed4e1fe6a1-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Lock "cinder-642ba98a-36cc-4946-97a3-3fed4e1fe6a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:29 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de 1073741824 Sep 05 21:07:29 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83a4e55-616c-4860-b977-eb4f08c5703b]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:29 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-94ae7834-a1ee-4db8-96ea-7829ed34717b" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-quobyte-94ae7834-a1ee-4db8-96ea-7829ed34717b" released by "delete_volume" :: held 0.958s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:29 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 Sep 05 21:07:29 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Created reservations ['1938451b-5bcf-4aeb-85e9-6cd07674f8df', '1fa3237a-f78c-4d41-90e9-1d501346ca8b', '87b4a36e-007e-4742-9b1e-5306d228ffbd', '81dd2d89-a6b6-4478-82a2-d03bfe046fb2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:29 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:29 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:30 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de 1073741824" returned: 0 in 0.619s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:30 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" returned: 0 in 0.455s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:30 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1 Sep 05 21:07:30 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:30 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de Sep 05 21:07:30 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:30 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.327s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Deleted volume successfully. Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7a735042-7fc7-418e-81ee-541f2f25d439 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-94ae7834-a1ee-4db8-96ea-7829ed34717b-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:30 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" returned: 0 in 0.355s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-642ba98a-36cc-4946-97a3-3fed4e1fe6a1" released by "delete_volume" :: held 0.891s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:30 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de" returned: 0 in 0.334s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9b24d0-97a5-4d8f-beba-d46b9b0b5637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74dce488-c2dc-4bdc-be66-f44298f819de', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305f8e41-39e7-42c5-acce-70f5338eb6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Created reservations ['1153b8e6-124d-419d-803a-f4aeef29a5e1', '3e3d3a3c-1cab-46d5-8195-1e9892fc0358', 'baca9f99-9dc9-4c19-be11-9961448b7a8f', '2576d9da-6ddd-41cb-b994-4d67ea098b06'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:30 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Volume volume-74dce488-c2dc-4bdc-be66-f44298f819de (74dce488-c2dc-4bdc-be66-f44298f819de): created successfully Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305f8e41-39e7-42c5-acce-70f5338eb6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (fdcf7b6d-9c03-4530-8b60-37e1c29f21ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-4688c594-f1af-41e6-9100-f6631ef596cf tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:30 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:30 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:30 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.269s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:30 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Deleted volume successfully. Sep 05 21:07:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-f45f2467-e13c-4950-9916-54a02145d803 tempest-ProjectReaderTests-78117735 None] Lock "cinder-642ba98a-36cc-4946-97a3-3fed4e1fe6a1-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Flow 'volume_create_manager' (8336cfce-21b9-440d-8aef-7373bc355619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1adcffc-6414-486a-8739-0da80e043080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1adcffc-6414-486a-8739-0da80e043080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157431150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce74b7f9-a5cc-4313-a48b-4874ae253e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735b241fe0040f585745bd39c50be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:31Z,use_quota=True,user_id='a649c677ae5842a6b02137352d7b7797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee572798-826f-4dd6-831e-5cde3e8f7e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee572798-826f-4dd6-831e-5cde3e8f7e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3d639d-ac13-4de1-9345-34f0f7b0c969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3d639d-ac13-4de1-9345-34f0f7b0c969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce74b7f9-a5cc-4313-a48b-4874ae253e85', 'volume_name': 'volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63acd53f-bff3-44e2-bc38-66f3e447b299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63acd53f-bff3-44e2-bc38-66f3e447b299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5125fb32-dfba-4627-9312-6d1b0781df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:31 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Volume ce74b7f9-a5cc-4313-a48b-4874ae253e85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85', 'volume_size': 1} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157431150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce74b7f9-a5cc-4313-a48b-4874ae253e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735b241fe0040f585745bd39c50be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:31Z,use_quota=True,user_id='a649c677ae5842a6b02137352d7b7797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Creating volume ce74b7f9-a5cc-4313-a48b-4874ae253e85 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:31 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:31 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 1073741824 Sep 05 21:07:31 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:32 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 1073741824" returned: 0 in 0.551s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:32 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 Sep 05 21:07:32 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (03abcdbe-c997-4d69-9336-e91a711ed665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e06367b-e592-406b-8f06-91084af7a481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e06367b-e592-406b-8f06-91084af7a481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941057042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadde405-e112-464f-8ecc-7864e39e7d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:32Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07730433-101d-4bbf-89dc-3d54a29a7eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07730433-101d-4bbf-89dc-3d54a29a7eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c6e04a-89a4-4d31-86b2-06548fb36410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c6e04a-89a4-4d31-86b2-06548fb36410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadde405-e112-464f-8ecc-7864e39e7d9c', 'volume_name': 'volume-fadde405-e112-464f-8ecc-7864e39e7d9c', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9dfd40-ac7a-455f-89ad-164216e11c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9dfd40-ac7a-455f-89ad-164216e11c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998e997f-32dd-4f43-ad03-638da7791542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:32 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Volume fadde405-e112-464f-8ecc-7864e39e7d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadde405-e112-464f-8ecc-7864e39e7d9c', 'volume_size': 1} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:32 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85" returned: 0 in 0.350s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.748s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot a8a1a677-2301-41a8-9ca6-408fdd489fca of volume 74dce488-c2dc-4bdc-be66-f44298f819de {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5125fb32-dfba-4627-9312-6d1b0781df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8582913c-9b89-40c0-b660-1d90e56805ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a77a2a-63aa-47de-bad4-781e4cd6fe0f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:32 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Volume volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 (ce74b7f9-a5cc-4313-a48b-4874ae253e85): created successfully Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8582913c-9b89-40c0-b660-1d90e56805ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Flow 'volume_create_manager' (8336cfce-21b9-440d-8aef-7373bc355619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:32 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-29a32ffa-71a9-48b5-8eaf-993d65ee9560 tempest-ProjectReaderTests-2011502081 None] Created volume successfully. Sep 05 21:07:32 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de Sep 05 21:07:32 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:32 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de" returned: 0 in 0.357s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:32 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:32 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca 1G Sep 05 21:07:32 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:33 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca 1G" returned: 0 in 0.386s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74dce488-c2dc-4bdc-be66-f44298f819de -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:33 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74dce488-c2dc-4bdc-be66-f44298f819de -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca Sep 05 21:07:33 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "cinder-ce74b7f9-a5cc-4313-a48b-4874ae253e85-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-ce74b7f9-a5cc-4313-a48b-4874ae253e85-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "cinder-quobyte-ce74b7f9-a5cc-4313-a48b-4874ae253e85" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:33 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74dce488-c2dc-4bdc-be66-f44298f819de -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca" returned: 0 in 0.338s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:33 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca is being set with open permissions: ugo+rw Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-quobyte-ce74b7f9-a5cc-4313-a48b-4874ae253e85" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:33 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca Sep 05 21:07:33 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2416e1-3c9c-43d1-9a91-63e398efc813]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:33 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 Sep 05 21:07:33 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:33 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca" returned: 0 in 0.277s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:33 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.info Sep 05 21:07:33 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:33 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85" returned: 0 in 0.388s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:33 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:33 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85 Sep 05 21:07:33 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:34 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.info" returned: 0 in 0.317s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:34 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.info is being set with open permissions: ugo+rw Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:34 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.info Sep 05 21:07:34 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:34 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-ce74b7f9-a5cc-4313-a48b-4874ae253e85" returned: 0 in 0.295s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-quobyte-ce74b7f9-a5cc-4313-a48b-4874ae253e85" released by "delete_volume" :: held 0.747s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Created reservations ['9c30c3b2-0740-413a-928c-e4fa0a3a77a0', '34393d15-f6f4-4c81-b04c-ea34fcbea339', '306463a7-b56a-4321-96fe-2e76425b2928', 'fa346570-907a-4302-a7e2-f0c3bb105272'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:34 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.info" returned: 0 in 0.302s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:34 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:34 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.136s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941057042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadde405-e112-464f-8ecc-7864e39e7d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:32Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Creating volume fadde405-e112-464f-8ecc-7864e39e7d9c {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:34 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:34 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c 1073741824 Sep 05 21:07:34 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:34 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1a0e35fb-eb88-4ee6-b1e4-00828a2b2fd0 tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:07:34 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.263s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:34 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Deleted volume successfully. Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-a62a0c38-ac9e-48f5-a629-f499b9a0fb16 tempest-ProjectReaderTests-2011502081 None] Lock "cinder-ce74b7f9-a5cc-4313-a48b-4874ae253e85-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-a8a1a677-2301-41a8-9ca6-408fdd489fca-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-a8a1a677-2301-41a8-9ca6-408fdd489fca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-74dce488-c2dc-4bdc-be66-f44298f819de" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-74dce488-c2dc-4bdc-be66-f44298f819de" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-a8a1a677-2301-41a8-9ca6-408fdd489fca" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-a8a1a677-2301-41a8-9ca6-408fdd489fca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot a8a1a677-2301-41a8-9ca6-408fdd489fca of volume 74dce488-c2dc-4bdc-be66-f44298f819de {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff86aa83-0341-4b5b-87db-b3bcc9a54a7e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:34 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:35 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c 1073741824" returned: 0 in 0.555s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:35 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca Sep 05 21:07:35 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:35 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c Sep 05 21:07:35 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:35 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c" returned: 0 in 0.280s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998e997f-32dd-4f43-ad03-638da7791542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadde405-e112-464f-8ecc-7864e39e7d9c', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:35 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976f79d0-592b-46c5-9463-04f653f23a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca" returned: 0 in 0.484s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74dce488-c2dc-4bdc-be66-f44298f819de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:35 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Volume volume-fadde405-e112-464f-8ecc-7864e39e7d9c (fadde405-e112-464f-8ecc-7864e39e7d9c): created successfully Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976f79d0-592b-46c5-9463-04f653f23a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (03abcdbe-c997-4d69-9336-e91a711ed665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[3930443a-c262-4ff9-ad66-34b7b1745405]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:35 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d1dba947-234e-4ea2-8db3-b6214eed0a94 tempest-ProjectReaderTests-78117735 None] Created volume successfully. Sep 05 21:07:35 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de Sep 05 21:07:35 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:35 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de" returned: 0 in 0.412s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:35 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:35 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca Sep 05 21:07:35 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:36 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca" returned: 0 in 0.400s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:36 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca Sep 05 21:07:36 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:36 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de.a8a1a677-2301-41a8-9ca6-408fdd489fca" returned: 0 in 0.345s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-a8a1a677-2301-41a8-9ca6-408fdd489fca" released by "_delete_snapshot" :: held 1.752s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-74dce488-c2dc-4bdc-be66-f44298f819de" released by "delete_snapshot" :: held 1.784s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Created reservations ['b365aacd-24c5-4aef-8186-4ff5e61604b4', '4681d6f6-929f-42eb-bdff-394939f85aaa', 'e3173089-965b-4380-bf7c-a49e35cd0c22', 'ca00ca65-4180-43f3-a109-522acf62872b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Creating offline snapshot 57665359-de0e-4587-8158-bc354ae046ee of volume fadde405-e112-464f-8ecc-7864e39e7d9c {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc3ac1-b360-464b-9faf-73527ab29040]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:36 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:07:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-16e9d3ea-cf47-4442-813a-11019d9c5790 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-a8a1a677-2301-41a8-9ca6-408fdd489fca-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:36 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c Sep 05 21:07:36 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-74dce488-c2dc-4bdc-be66-f44298f819de-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-74dce488-c2dc-4bdc-be66-f44298f819de-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-74dce488-c2dc-4bdc-be66-f44298f819de" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-74dce488-c2dc-4bdc-be66-f44298f819de" acquired by "delete_volume" :: waited 0.028s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa27ffe-4501-4386-9204-2052c262fc0f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:37 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c" returned: 0 in 0.397s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:37 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee 1G Sep 05 21:07:37 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:37 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de Sep 05 21:07:37 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:37 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de" returned: 0 in 0.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:37 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de Sep 05 21:07:37 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:37 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee 1G" returned: 0 in 0.438s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fadde405-e112-464f-8ecc-7864e39e7d9c -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:37 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fadde405-e112-464f-8ecc-7864e39e7d9c -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee Sep 05 21:07:37 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:37 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-74dce488-c2dc-4bdc-be66-f44298f819de" returned: 0 in 0.255s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-74dce488-c2dc-4bdc-be66-f44298f819de" released by "delete_volume" :: held 0.682s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Created reservations ['75f7b8d0-a033-4286-9a57-ca06becbf9a4', 'faac9935-aa5f-48fb-a77d-337cd9ab76b2', 'e48ddfe1-c04d-406f-a196-f1bd6a0a1aef', '3f44938a-305a-4bc1-abbe-20f82712ee10'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:37 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:37 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:37 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fadde405-e112-464f-8ecc-7864e39e7d9c -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee" returned: 0 in 0.328s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:37 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee is being set with open permissions: ugo+rw Sep 05 21:07:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:38 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee Sep 05 21:07:38 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:38 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.279s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7f5c65e9-ce09-4301-b489-5324e573b520 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-74dce488-c2dc-4bdc-be66-f44298f819de-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:38 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee" returned: 0 in 0.272s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:38 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.info Sep 05 21:07:38 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:38 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.info" returned: 0 in 0.341s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:38 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.info is being set with open permissions: ugo+rw Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:38 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.info Sep 05 21:07:38 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (1422eaf9-b8e3-4d56-bd22-95f9bc7cff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf38c19-6a47-47c8-a4dc-44c4d3dafed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf38c19-6a47-47c8-a4dc-44c4d3dafed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183705058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0081ac1b-ea81-476f-afc8-752d177a2ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:39Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4abf03b-d120-4d12-a3c1-ded3e6832d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4abf03b-d120-4d12-a3c1-ded3e6832d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14437423-1596-44e2-bdd7-5266c0182202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14437423-1596-44e2-bdd7-5266c0182202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0081ac1b-ea81-476f-afc8-752d177a2ea7', 'volume_name': 'volume-0081ac1b-ea81-476f-afc8-752d177a2ea7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f787b7-53db-4dd5-9af6-77e3df39bb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f787b7-53db-4dd5-9af6-77e3df39bb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fc2943-9d58-45a5-934b-2a9f37a4f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:38 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Volume 0081ac1b-ea81-476f-afc8-752d177a2ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0081ac1b-ea81-476f-afc8-752d177a2ea7', 'volume_size': 1} Sep 05 21:07:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:39 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.info" returned: 0 in 0.420s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183705058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0081ac1b-ea81-476f-afc8-752d177a2ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:39Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Creating volume 0081ac1b-ea81-476f-afc8-752d177a2ea7 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:39 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:39 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 1073741824 Sep 05 21:07:39 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-858e6034-4712-463e-8e0c-82a841594afa tempest-ProjectReaderTests-78117735 None] Create snapshot completed successfully Sep 05 21:07:39 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 1073741824" returned: 0 in 0.429s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:39 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 Sep 05 21:07:39 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:39 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7" returned: 0 in 0.248s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fc2943-9d58-45a5-934b-2a9f37a4f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0081ac1b-ea81-476f-afc8-752d177a2ea7', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ef9abe-41da-4985-8bd4-7126da873705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:39 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Volume volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 (0081ac1b-ea81-476f-afc8-752d177a2ea7): created successfully Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ef9abe-41da-4985-8bd4-7126da873705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (1422eaf9-b8e3-4d56-bd22-95f9bc7cff41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:39 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-9ae59518-5705-43c5-ae4b-36e43b6921f0 tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-57665359-de0e-4587-8158-bc354ae046ee-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Lock "cinder-57665359-de0e-4587-8158-bc354ae046ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-fadde405-e112-464f-8ecc-7864e39e7d9c" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-fadde405-e112-464f-8ecc-7864e39e7d9c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-57665359-de0e-4587-8158-bc354ae046ee" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-57665359-de0e-4587-8158-bc354ae046ee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Deleting offline snapshot 57665359-de0e-4587-8158-bc354ae046ee of volume fadde405-e112-464f-8ecc-7864e39e7d9c {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] snapshot_file for this snap is: volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dcb4de-6f54-4a2f-a117-1f391eb9dc08]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:40 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee Sep 05 21:07:40 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:40 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee" returned: 0 in 0.374s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fadde405-e112-464f-8ecc-7864e39e7d9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cd79a8-052f-4d03-9d07-33bc8039d615]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:40 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c Sep 05 21:07:40 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:40 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c" returned: 0 in 0.373s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:40 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee Sep 05 21:07:40 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot 6463a1db-f921-458f-b953-bde379e161d8 of volume 0081ac1b-ea81-476f-afc8-752d177a2ea7 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7af9aab-bb64-41f4-ba2a-9e2300771c84]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:41 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee" returned: 0 in 0.401s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:41 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee Sep 05 21:07:41 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:41 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 Sep 05 21:07:41 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:41 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c.57665359-de0e-4587-8158-bc354ae046ee" returned: 0 in 0.279s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:41 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7" returned: 0 in 0.419s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-57665359-de0e-4587-8158-bc354ae046ee" released by "_delete_snapshot" :: held 1.551s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-fadde405-e112-464f-8ecc-7864e39e7d9c" released by "delete_snapshot" :: held 1.577s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:41 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 1G Sep 05 21:07:41 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Created reservations ['45a669e1-b9a7-49f0-bf43-7f36e0d590bf', 'b8d15c7f-a21c-43e6-9d13-febe1779cf55', '741990aa-8a27-4e2a-a374-ec9ac01adaa1', 'fe70b546-1157-40f9-9333-ac3115f61555'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Delete snapshot completed successfully. Sep 05 21:07:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-6e5d358b-01e6-49f8-8687-3d25156f5bd8 tempest-ProjectReaderTests-78117735 None] Lock "cinder-57665359-de0e-4587-8158-bc354ae046ee-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:42 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 1G" returned: 0 in 0.533s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:42 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 Sep 05 21:07:42 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-fadde405-e112-464f-8ecc-7864e39e7d9c-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Lock "cinder-fadde405-e112-464f-8ecc-7864e39e7d9c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-fadde405-e112-464f-8ecc-7864e39e7d9c" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-fadde405-e112-464f-8ecc-7864e39e7d9c" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c809ec-269e-4801-9f32-455bb2b81921]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:42 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c Sep 05 21:07:42 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:42 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8" returned: 0 in 0.375s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:42 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 is being set with open permissions: ugo+rw Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:42 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 Sep 05 21:07:42 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:42 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c" returned: 0 in 0.401s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:42 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8" returned: 0 in 0.276s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:42 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c Sep 05 21:07:42 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:42 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:42 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.info Sep 05 21:07:42 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:43 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-fadde405-e112-464f-8ecc-7864e39e7d9c" returned: 0 in 0.274s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:43 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.info" returned: 0 in 0.256s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:43 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.info is being set with open permissions: ugo+rw Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-fadde405-e112-464f-8ecc-7864e39e7d9c" released by "delete_volume" :: held 0.752s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:43 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.info Sep 05 21:07:43 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Created reservations ['c15cbe2f-fc13-4f4e-9d04-a92dadad9e53', 'd8abdc89-a83a-4ad7-91dc-f9f0ec9c1aff', '5f77fe72-749f-42d1-ade4-471bc6604b12', '9ec410b7-59a0-46bb-b05f-180829cb5e0a'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:43 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:43 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:43 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.info" returned: 0 in 0.309s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6b18b7ce-abc2-4f7f-853f-02edd8661b4b tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:07:43 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.298s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:43 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Deleted volume successfully. Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-8e6508a3-731b-464c-8fb0-8ac0723c7d0c tempest-ProjectReaderTests-78117735 None] Lock "cinder-fadde405-e112-464f-8ecc-7864e39e7d9c-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (86146a8a-3451-40a4-80c9-40b2a9613098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a48d2ca-0c4c-428f-bbfc-ae186640bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a48d2ca-0c4c-428f-bbfc-ae186640bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-690393513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c2d39f-f7c4-4945-b3b8-8eca97190689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:44Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7d2737-29e9-46fe-9b44-6c5717c1a9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7d2737-29e9-46fe-9b44-6c5717c1a9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a2321f-4600-47f7-998a-53c82f560e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a2321f-4600-47f7-998a-53c82f560e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c2d39f-f7c4-4945-b3b8-8eca97190689', 'volume_name': 'volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898152c4-62ab-4910-b748-2e23cd956e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898152c4-62ab-4910-b748-2e23cd956e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce92999d-0143-4bd6-bd70-7839a63ff3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:43 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Volume c1c2d39f-f7c4-4945-b3b8-8eca97190689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689', 'volume_size': 1} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-690393513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c2d39f-f7c4-4945-b3b8-8eca97190689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:44Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Creating volume c1c2d39f-f7c4-4945-b3b8-8eca97190689 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:43 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:43 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:44 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 1073741824 Sep 05 21:07:44 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-6463a1db-f921-458f-b953-bde379e161d8-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-6463a1db-f921-458f-b953-bde379e161d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-0081ac1b-ea81-476f-afc8-752d177a2ea7" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-0081ac1b-ea81-476f-afc8-752d177a2ea7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-6463a1db-f921-458f-b953-bde379e161d8" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-6463a1db-f921-458f-b953-bde379e161d8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot 6463a1db-f921-458f-b953-bde379e161d8 of volume 0081ac1b-ea81-476f-afc8-752d177a2ea7 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e031609b-a771-4410-a88f-ad6489ca2754]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:44 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 1073741824" returned: 0 in 0.503s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:44 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 Sep 05 21:07:44 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:44 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 Sep 05 21:07:44 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:44 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689" returned: 0 in 0.260s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:44 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8" returned: 0 in 0.404s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0081ac1b-ea81-476f-afc8-752d177a2ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce92999d-0143-4bd6-bd70-7839a63ff3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10692bab-3f11-46e4-8c5a-bab7e44713bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[26016834-1d7b-4457-94ea-890b023dad5c]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:44 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Volume volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 (c1c2d39f-f7c4-4945-b3b8-8eca97190689): created successfully Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10692bab-3f11-46e4-8c5a-bab7e44713bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:44 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (86146a8a-3451-40a4-80c9-40b2a9613098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:44 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-23ce58c9-aa9c-43f5-b9fd-7df391ea1171 tempest-ProjectReaderTests-78117735 None] Created volume successfully. Sep 05 21:07:44 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 Sep 05 21:07:44 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:45 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7" returned: 0 in 0.365s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:45 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 Sep 05 21:07:45 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:45 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8" returned: 0 in 0.311s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:45 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8 Sep 05 21:07:45 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:45 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7.6463a1db-f921-458f-b953-bde379e161d8" returned: 0 in 0.235s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-6463a1db-f921-458f-b953-bde379e161d8" released by "_delete_snapshot" :: held 1.413s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-0081ac1b-ea81-476f-afc8-752d177a2ea7" released by "delete_snapshot" :: held 1.435s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Created reservations ['b4f0c617-fce6-4eff-a329-6eec9a65fe73', 'e5d2816e-146b-4d10-90f4-6d7f4f7f9310', '123d79a9-c2f1-429d-a630-3e29ec3d134e', '49fe371f-4670-4154-abb9-877a4ac76ca5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:45 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:07:45 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-51707419-5ee5-4983-b830-7f493d0512a8 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-6463a1db-f921-458f-b953-bde379e161d8-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Creating offline snapshot 2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 of volume c1c2d39f-f7c4-4945-b3b8-8eca97190689 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[07de2010-8706-4d02-96cc-f63a4a789e9f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:46 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 Sep 05 21:07:46 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:46 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689" returned: 0 in 0.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-0081ac1b-ea81-476f-afc8-752d177a2ea7-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:46 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 1G Sep 05 21:07:46 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-0081ac1b-ea81-476f-afc8-752d177a2ea7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-0081ac1b-ea81-476f-afc8-752d177a2ea7" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-0081ac1b-ea81-476f-afc8-752d177a2ea7" acquired by "delete_volume" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4108db1-fd75-402e-be64-686b5c2cd9a7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:46 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 Sep 05 21:07:46 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:46 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 1G" returned: 0 in 0.394s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:46 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 Sep 05 21:07:46 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:46 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7" returned: 0 in 0.362s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:46 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:46 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7 Sep 05 21:07:46 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:47 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0" returned: 0 in 0.304s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:47 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 is being set with open permissions: ugo+rw Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:47 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 Sep 05 21:07:47 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:47 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0081ac1b-ea81-476f-afc8-752d177a2ea7" returned: 0 in 0.255s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-0081ac1b-ea81-476f-afc8-752d177a2ea7" released by "delete_volume" :: held 0.672s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Created reservations ['2f2cbda4-c597-41d9-b387-5e4ee6f14f4c', '4f318745-9771-4536-b94d-c33d404c600f', '4dd793a2-256d-4134-b405-e33c463d751d', '9ebae60a-3ac4-4a28-8cae-264c05d96d3d'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:47 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0" returned: 0 in 0.243s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:47 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:47 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:47 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.info Sep 05 21:07:47 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:47 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.248s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-997ce90a-abf6-4b38-9548-bfbea81930c0 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-0081ac1b-ea81-476f-afc8-752d177a2ea7-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:47 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.info" returned: 0 in 0.247s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:47 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.info is being set with open permissions: ugo+rw Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:47 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.info Sep 05 21:07:47 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:47 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.info" returned: 0 in 0.245s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:47 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:47 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e4208bff-93d9-47b1-a5e7-636336291693 tempest-ProjectReaderTests-78117735 None] Create snapshot completed successfully Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (5cb13b38-32db-41d2-a606-19f9e46c6227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6549bb52-cf6f-4657-8814-940df79ad45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6549bb52-cf6f-4657-8814-940df79ad45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086545865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:48Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e7dce3-7b4f-43e0-a596-3f4870444b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e7dce3-7b4f-43e0-a596-3f4870444b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603e69af-b1c9-4b4f-a59e-f06df7979dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603e69af-b1c9-4b4f-a59e-f06df7979dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6', 'volume_name': 'volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e75a63-735a-4f82-84d8-05fdaa2e5547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e75a63-735a-4f82-84d8-05fdaa2e5547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8893ed87-2401-4a7a-bd8a-a27d14452625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Volume 0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6', 'volume_size': 1} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086545865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:48Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Creating volume 0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:48 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:48 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 1073741824 Sep 05 21:07:48 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-c1c2d39f-f7c4-4945-b3b8-8eca97190689" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-c1c2d39f-f7c4-4945-b3b8-8eca97190689" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Deleting offline snapshot 2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 of volume c1c2d39f-f7c4-4945-b3b8-8eca97190689 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] snapshot_file for this snap is: volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[6092b951-683d-4290-b5bf-c9a69701126f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:48 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 Sep 05 21:07:48 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:48 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 1073741824" returned: 0 in 0.406s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:48 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0" returned: 0 in 0.372s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:48 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 Sep 05 21:07:48 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bdf40f-2940-4b04-b287-a34c0323f0aa]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:48 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 Sep 05 21:07:48 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:48 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" returned: 0 in 0.245s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8893ed87-2401-4a7a-bd8a-a27d14452625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02971644-3a34-41cc-8ee6-8d820c401d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:48 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Volume volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 (0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6): created successfully Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02971644-3a34-41cc-8ee6-8d820c401d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:48 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (5cb13b38-32db-41d2-a606-19f9e46c6227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:48 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-5fc3c47b-4c72-494c-871f-0bdcade0bdf1 tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:07:49 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689" returned: 0 in 0.384s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:49 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 Sep 05 21:07:49 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot 1268dd5b-4ce9-448d-85b4-69d1b5852aee of volume 0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbec6b58-3d22-4a27-94fc-a0c573bfd833]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:49 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 Sep 05 21:07:49 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0" returned: 0 in 0.340s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:49 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0 Sep 05 21:07:49 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" returned: 0 in 0.353s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:49 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee 1G Sep 05 21:07:49 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689.2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0" returned: 0 in 0.260s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0" released by "_delete_snapshot" :: held 1.445s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-c1c2d39f-f7c4-4945-b3b8-8eca97190689" released by "delete_snapshot" :: held 1.465s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Created reservations ['e42bd8d5-9a18-4e35-b233-cfbac397c876', 'b94d8184-234b-4c93-861e-10bb1d784944', '2bce3b76-28ca-4e06-b242-0dd12c82af58', 'ac10e7b4-373d-414c-9926-558d168c1cb3'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:49 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Delete snapshot completed successfully. Sep 05 21:07:49 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-371baf9d-443a-48ba-a004-0287fae3e6c5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-2ac6a4d7-3fc1-473a-9d35-ed7e7f4e02c0-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:50 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee 1G" returned: 0 in 0.365s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee Sep 05 21:07:50 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee" returned: 0 in 0.289s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:50 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee is being set with open permissions: ugo+rw Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee Sep 05 21:07:50 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-c1c2d39f-f7c4-4945-b3b8-8eca97190689-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Lock "cinder-c1c2d39f-f7c4-4945-b3b8-8eca97190689-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-c1c2d39f-f7c4-4945-b3b8-8eca97190689" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-c1c2d39f-f7c4-4945-b3b8-8eca97190689" acquired by "delete_volume" :: waited 0.013s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[f729a9bc-2215-4377-a31b-f8960ce3d540]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee" returned: 0 in 0.246s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 Sep 05 21:07:50 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.info Sep 05 21:07:50 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.info" returned: 0 in 0.238s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:50 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.info is being set with open permissions: ugo+rw Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:50 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.info Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689" returned: 0 in 0.358s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:50 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689 Sep 05 21:07:50 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:51 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.info" returned: 0 in 0.245s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:51 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c1c2d39f-f7c4-4945-b3b8-8eca97190689" returned: 0 in 0.247s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-c1c2d39f-f7c4-4945-b3b8-8eca97190689" released by "delete_volume" :: held 0.660s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-f887a2b8-5c10-44f4-b103-37b8e25bc80f tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Created reservations ['13bcd52e-e62d-4cef-9063-c60da0de050a', 'c32b0c41-8abe-4d7d-96f5-c64a16e42d1d', 'e1a91c24-05ae-436e-8916-2172e13f593e', '52e39be4-76a4-48f2-927e-f2840975cda0'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:51 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-1268dd5b-4ce9-448d-85b4-69d1b5852aee-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-1268dd5b-4ce9-448d-85b4-69d1b5852aee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-1268dd5b-4ce9-448d-85b4-69d1b5852aee" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-1268dd5b-4ce9-448d-85b4-69d1b5852aee" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot 1268dd5b-4ce9-448d-85b4-69d1b5852aee of volume 0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:51 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.282s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:51 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Deleted volume successfully. Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[78be9923-8b8c-446b-be74-253a2ddfb476]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-331452e0-672b-42fa-90c1-b1493d7fdbfc tempest-ProjectReaderTests-78117735 None] Lock "cinder-c1c2d39f-f7c4-4945-b3b8-8eca97190689-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:51 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee Sep 05 21:07:51 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:51 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cafb26-2cbc-4570-9725-d2ad87dd7f15]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (c4d13b91-3a15-4f9d-87db-f9b8c580e538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:51 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac9f942-33b5-432e-96a2-96f8b2b4085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac9f942-33b5-432e-96a2-96f8b2b4085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029159594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df30048-ab0d-4c43-a4e1-dff1b1e422a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:52Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bd2fd3-b71b-4a29-ab1c-1fb74b62b5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bd2fd3-b71b-4a29-ab1c-1fb74b62b5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fa0690-361d-426b-bb49-e67b4b5a64e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:52 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 Sep 05 21:07:52 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fa0690-361d-426b-bb49-e67b4b5a64e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df30048-ab0d-4c43-a4e1-dff1b1e422a5', 'volume_name': 'volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b4635c-6fd3-49f1-af32-496a0ada6f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b4635c-6fd3-49f1-af32-496a0ada6f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fac72d-fece-434f-84ea-be18c796fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Volume 6df30048-ab0d-4c43-a4e1-dff1b1e422a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5', 'volume_size': 1} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029159594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df30048-ab0d-4c43-a4e1-dff1b1e422a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:52Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Creating volume 6df30048-ab0d-4c43-a4e1-dff1b1e422a5 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:52 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:52 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 1073741824 Sep 05 21:07:52 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:52 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" returned: 0 in 0.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:52 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee Sep 05 21:07:52 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:52 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 1073741824" returned: 0 in 0.406s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:52 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 Sep 05 21:07:52 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:52 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee" returned: 0 in 0.337s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:52 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee Sep 05 21:07:52 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:52 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" returned: 0 in 0.232s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fac72d-fece-434f-84ea-be18c796fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c067a5e1-46f5-4f6f-a40f-4528c613bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:52 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Volume volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 (6df30048-ab0d-4c43-a4e1-dff1b1e422a5): created successfully Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c067a5e1-46f5-4f6f-a40f-4528c613bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (c4d13b91-3a15-4f9d-87db-f9b8c580e538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-d6a23c5b-d81a-4b93-9e27-a6800f3b0d93 tempest-ProjectReaderTests-78117735 None] Created volume successfully. Sep 05 21:07:52 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6.1268dd5b-4ce9-448d-85b4-69d1b5852aee" returned: 0 in 0.240s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-1268dd5b-4ce9-448d-85b4-69d1b5852aee" released by "_delete_snapshot" :: held 1.436s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" released by "delete_snapshot" :: held 1.456s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Created reservations ['21fe2a5e-4e50-4671-9f90-a86ed36140f9', '24f34dfb-1b10-488c-8630-7487788b25fb', '0de6748a-1597-4be2-b8e5-b76708e3acea', '92246a59-713d-4858-972e-8fbe9c0d88c7'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:52 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:07:52 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-074dd957-dfd2-4feb-a0e2-e5c0b43fcc63 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-1268dd5b-4ce9-448d-85b4-69d1b5852aee-delete_snapshot" released by "delete_snapshot" :: held 1.587s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Creating offline snapshot 75a3aecb-0a4b-4c34-abda-1e89a94cdacc of volume 6df30048-ab0d-4c43-a4e1-dff1b1e422a5 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[350c4b01-df10-4f1b-bd96-d1382babf66a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:53 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 Sep 05 21:07:53 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:53 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" returned: 0 in 0.357s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:53 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc 1G Sep 05 21:07:53 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" acquired by "delete_volume" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[d111cbf6-5a25-42aa-a2ca-50f9fda1ccce]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:53 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 Sep 05 21:07:53 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:53 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc 1G" returned: 0 in 0.390s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:53 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:53 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc Sep 05 21:07:53 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:54 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" returned: 0 in 0.355s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:54 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6 Sep 05 21:07:54 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:54 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc" returned: 0 in 0.293s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:54 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc is being set with open permissions: ugo+rw Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:54 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc Sep 05 21:07:54 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:54 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" returned: 0 in 0.244s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6" released by "delete_volume" :: held 0.650s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Created reservations ['b8e1105b-28f8-4031-b8df-9b8ee0cf04fc', '7c8a4efb-6975-4876-9fde-0e3199321ee5', '83a03870-fcfe-4cf1-87f5-62aea8aeeb7e', 'e6eb8a91-41da-4d3e-82da-6411476196f2'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:54 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:54 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:54 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc" returned: 0 in 0.241s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:54 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.info Sep 05 21:07:54 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:54 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.262s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:54 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-63f3d546-3297-4fa2-ac30-e65cf653be30 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-0d6c35e3-fbf6-45d6-8b8c-d574ef7f7bf6-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:54 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.info" returned: 0 in 0.256s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:54 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.info is being set with open permissions: ugo+rw Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:54 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.info Sep 05 21:07:54 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:54 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:54 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.info" returned: 0 in 0.240s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-dc10f5c3-d56e-49af-83af-04774a746d48 tempest-ProjectReaderTests-78117735 None] Create snapshot completed successfully Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (d25b61ea-3b16-4769-8235-a5c9ad1dfbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e97c458-6e58-496a-a9cc-6b4b4b928f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e97c458-6e58-496a-a9cc-6b4b4b928f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808986078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1b5c0b-de0c-418e-8ec6-ce9c1430d029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:55Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7f02b3-7a05-4fa9-9230-b8d1586f9f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7f02b3-7a05-4fa9-9230-b8d1586f9f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637e8168-2b07-45b7-abe6-98e028dd4e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637e8168-2b07-45b7-abe6-98e028dd4e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1b5c0b-de0c-418e-8ec6-ce9c1430d029', 'volume_name': 'volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31211279-316f-43c3-b2cb-068442001b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31211279-316f-43c3-b2cb-068442001b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04150d05-206a-49f1-800b-75fc3986cecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:55 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Volume 7f1b5c0b-de0c-418e-8ec6-ce9c1430d029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029', 'volume_size': 1} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808986078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1b5c0b-de0c-418e-8ec6-ce9c1430d029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:55Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Creating volume 7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:55 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:55 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 1073741824 Sep 05 21:07:55 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-75a3aecb-0a4b-4c34-abda-1e89a94cdacc-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Lock "cinder-75a3aecb-0a4b-4c34-abda-1e89a94cdacc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-75a3aecb-0a4b-4c34-abda-1e89a94cdacc" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-75a3aecb-0a4b-4c34-abda-1e89a94cdacc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Deleting offline snapshot 75a3aecb-0a4b-4c34-abda-1e89a94cdacc of volume 6df30048-ab0d-4c43-a4e1-dff1b1e422a5 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] snapshot_file for this snap is: volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a2fdf4-8fba-408e-a3e0-ce6fd4ff3912]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:55 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc Sep 05 21:07:55 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:55 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 1073741824" returned: 0 in 0.392s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:55 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 Sep 05 21:07:55 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:55 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc" returned: 0 in 0.367s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:55 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:55 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a346112-2b5b-4a97-9bf6-a8478963db5a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:55 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 Sep 05 21:07:55 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:55 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" returned: 0 in 0.236s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04150d05-206a-49f1-800b-75fc3986cecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3f64f6-369d-4670-8434-06169056def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:55 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Volume volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 (7f1b5c0b-de0c-418e-8ec6-ce9c1430d029): created successfully Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3f64f6-369d-4670-8434-06169056def8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (d25b61ea-3b16-4769-8235-a5c9ad1dfbae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:55 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:55 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-eb84f1fe-6d86-4971-a2a6-578111d01079 tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.265s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:07:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:07:56 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:56 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc Sep 05 21:07:56 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot 07184420-1dad-46ae-a958-723f5950ed7f of volume 7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdcaedb-0510-4bc8-876c-2ff34e69a169]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:56 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 Sep 05 21:07:56 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:56 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc" returned: 0 in 0.331s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:56 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc Sep 05 21:07:56 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:56 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" returned: 0 in 0.349s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:56 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5.75a3aecb-0a4b-4c34-abda-1e89a94cdacc" returned: 0 in 0.246s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:56 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f 1G Sep 05 21:07:56 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-75a3aecb-0a4b-4c34-abda-1e89a94cdacc" released by "_delete_snapshot" :: held 1.422s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" released by "delete_snapshot" :: held 1.443s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Created reservations ['204e0ec1-5751-4de1-afaa-bdf71528b6a5', 'd87ac676-1d5a-44c6-a7eb-8dd28d707922', 'f6f0539a-8853-4a44-8886-19d2b833b8c9', 'a27cd622-f669-4b8c-a317-4b3ac18714df'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:56 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Delete snapshot completed successfully. Sep 05 21:07:56 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-3b5c5338-3baf-4520-ab92-fc219110f548 tempest-ProjectReaderTests-78117735 None] Lock "cinder-75a3aecb-0a4b-4c34-abda-1e89a94cdacc-delete_snapshot" released by "delete_snapshot" :: held 1.568s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:57 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f 1G" returned: 0 in 0.375s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:57 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f Sep 05 21:07:57 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:57 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f" returned: 0 in 0.276s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:57 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f is being set with open permissions: ugo+rw Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:57 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f Sep 05 21:07:57 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-6df30048-ab0d-4c43-a4e1-dff1b1e422a5-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Lock "cinder-6df30048-ab0d-4c43-a4e1-dff1b1e422a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[362c1ec8-f902-42f9-b7d0-a79a906a324d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:57 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f" returned: 0 in 0.244s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:57 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 Sep 05 21:07:57 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:57 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.info Sep 05 21:07:57 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:57 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.info" returned: 0 in 0.241s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:57 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.info is being set with open permissions: ugo+rw Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:57 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.info Sep 05 21:07:57 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:57 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" returned: 0 in 0.360s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:57 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:57 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5 Sep 05 21:07:57 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:58 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.info" returned: 0 in 0.246s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:58 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" returned: 0 in 0.246s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-6df30048-ab0d-4c43-a4e1-dff1b1e422a5" released by "delete_volume" :: held 0.658s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:58 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2a10ea6c-4fef-43f4-8042-353aa7ee296a tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Created reservations ['6b21237b-cf48-4b5f-92ae-30574d112a83', '3a7b0898-1d9a-4a40-995b-8f2c42879766', 'b1238f02-d7d4-4e4e-8446-30a322dee9a4', 'f0359498-f3e1-4d45-9140-82e913966db1'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:58 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:07:58 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-07184420-1dad-46ae-a958-723f5950ed7f-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-07184420-1dad-46ae-a958-723f5950ed7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-07184420-1dad-46ae-a958-723f5950ed7f" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-07184420-1dad-46ae-a958-723f5950ed7f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot 07184420-1dad-46ae-a958-723f5950ed7f of volume 7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:58 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.257s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6912f2-6999-44a4-857b-ec2877e5761d]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:58 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Deleted volume successfully. Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fe5e0120-0e98-429e-bc1c-c22306bde185 tempest-ProjectReaderTests-78117735 None] Lock "cinder-6df30048-ab0d-4c43-a4e1-dff1b1e422a5-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:58 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f Sep 05 21:07:58 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:58 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf58c95c-4482-4050-b1a0-0d793f5c6bd2]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:58 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (f723f649-cb1c-48d2-9a5e-6a27806ce4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95421079-7b2b-43a8-8a7b-ff08356d5911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:59 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 Sep 05 21:07:59 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95421079-7b2b-43a8-8a7b-ff08356d5911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135579693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ee6de6-fa1f-43e9-98e8-f6956990d0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:59Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44ddb45-a529-47c5-805e-a2f89e20341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44ddb45-a529-47c5-805e-a2f89e20341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20725667-9807-412e-ac8f-b03150337527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20725667-9807-412e-ac8f-b03150337527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ee6de6-fa1f-43e9-98e8-f6956990d0d6', 'volume_name': 'volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd50d5ee-b06b-4e9a-a339-c5845e876b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd50d5ee-b06b-4e9a-a339-c5845e876b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbcc22c-5ba6-4b3b-b447-295c08b63c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Volume 14ee6de6-fa1f-43e9-98e8-f6956990d0d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6', 'volume_size': 1} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135579693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ee6de6-fa1f-43e9-98e8-f6956990d0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1e1bf297484e1994be9eba741651e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:59Z,use_quota=True,user_id='fbf8dd9241bb4c9aa6fa16e60758077c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Creating volume 14ee6de6-fa1f-43e9-98e8-f6956990d0d6 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:07:59 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:59 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 1073741824 Sep 05 21:07:59 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:59 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" returned: 0 in 0.370s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:59 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f Sep 05 21:07:59 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:59 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 1073741824" returned: 0 in 0.413s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:59 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 Sep 05 21:07:59 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:59 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f" returned: 0 in 0.367s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:59 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f Sep 05 21:07:59 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:59 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" returned: 0 in 0.242s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbcc22c-5ba6-4b3b-b447-295c08b63c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413bc313-09a2-4005-b250-c6eb8ac40842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:59 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Volume volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 (14ee6de6-fa1f-43e9-98e8-f6956990d0d6): created successfully Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413bc313-09a2-4005-b250-c6eb8ac40842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Flow 'volume_create_manager' (f723f649-cb1c-48d2-9a5e-6a27806ce4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:59 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-79384857-c0af-4377-8ba0-f4fb37fd2fd3 tempest-ProjectReaderTests-78117735 None] Created volume successfully. Sep 05 21:07:59 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029.07184420-1dad-46ae-a958-723f5950ed7f" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-07184420-1dad-46ae-a958-723f5950ed7f" released by "_delete_snapshot" :: held 1.488s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:59 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" released by "delete_snapshot" :: held 1.513s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Created reservations ['975d07f9-3838-4519-8ce1-075623aa325f', '7efac69e-612a-425f-a7eb-b486e0ee27ee', '6e0f1306-dec4-4321-adcf-6f13a860eae8', '1a3f9b5b-334d-4620-825a-06b2b88a25c5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:00 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-fc3122be-8453-4a5b-8218-d905c7bf2aa9 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-07184420-1dad-46ae-a958-723f5950ed7f-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Creating offline snapshot dffd53f5-f7ed-4bfd-9151-b5f923be44e2 of volume 14ee6de6-fa1f-43e9-98e8-f6956990d0d6 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[772d7540-90ba-4360-a1cf-da483caf34e1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:00 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 Sep 05 21:08:00 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:00 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" returned: 0 in 0.376s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:00 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 1G Sep 05 21:08:00 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[db40a310-9b9e-41fb-bb77-7e1424c86bcf]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:00 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:00 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 Sep 05 21:08:00 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:01 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 1G" returned: 0 in 0.399s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 Sep 05 21:08:01 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:01 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029 Sep 05 21:08:01 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:01 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" returned: 0 in 0.246s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2" returned: 0 in 0.317s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 is being set with open permissions: ugo+rw Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029" released by "delete_volume" :: held 0.695s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:01 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 Sep 05 21:08:01 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Created reservations ['0e0ca7ff-8667-424a-9731-30bb4c67a0ca', '3b2e8cdb-4f0c-4979-8571-e796a78e460e', '03ae3034-d954-4e7d-99c7-61f60812edf1', '2fe12e88-a77a-4af6-a501-f003275a99b5'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:08:01 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:01 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2" returned: 0 in 0.239s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.info Sep 05 21:08:01 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:01 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.258s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:01 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2392506e-5332-4886-bcbd-fa98f4aa0454 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-7f1b5c0b-de0c-418e-8ec6-ce9c1430d029-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:01 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.info" returned: 0 in 0.272s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.info is being set with open permissions: ugo+rw Sep 05 21:08:01 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.info Sep 05 21:08:01 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:02 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.info" returned: 0 in 0.281s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:02 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1d76fae3-4acb-42ed-bb44-de276baf38b4 tempest-ProjectReaderTests-78117735 None] Create snapshot completed successfully Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (d66ee054-4212-4d10-804a-2515cecae93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e83ae4c-528d-4057-b6f7-8798cabbf45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e83ae4c-528d-4057-b6f7-8798cabbf45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10204806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81fddd8-749b-4b34-b21f-a96a7d2f8d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:02Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85794ae-f549-44aa-acb4-5f749cbc676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85794ae-f549-44aa-acb4-5f749cbc676b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbb9d88-9018-4787-a568-19119ba43e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbb9d88-9018-4787-a568-19119ba43e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c81fddd8-749b-4b34-b21f-a96a7d2f8d15', 'volume_name': 'volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d39d4f9-dbb5-4115-95fa-bee665de4b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d39d4f9-dbb5-4115-95fa-bee665de4b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423500b2-cfdd-4ac8-97a4-c199a5ee050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:02 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Volume c81fddd8-749b-4b34-b21f-a96a7d2f8d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15', 'volume_size': 1} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10204806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81fddd8-749b-4b34-b21f-a96a7d2f8d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:02Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Creating volume c81fddd8-749b-4b34-b21f-a96a7d2f8d15 {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:08:02 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:02 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 1073741824 Sep 05 21:08:02 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-dffd53f5-f7ed-4bfd-9151-b5f923be44e2-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-dffd53f5-f7ed-4bfd-9151-b5f923be44e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-dffd53f5-f7ed-4bfd-9151-b5f923be44e2" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-dffd53f5-f7ed-4bfd-9151-b5f923be44e2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Deleting offline snapshot dffd53f5-f7ed-4bfd-9151-b5f923be44e2 of volume 14ee6de6-fa1f-43e9-98e8-f6956990d0d6 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] snapshot_file for this snap is: volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed7c309-282a-476e-b614-61f0efa0d923]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:02 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 Sep 05 21:08:02 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:02 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 1073741824" returned: 0 in 0.428s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:02 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 Sep 05 21:08:02 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:02 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2" returned: 0 in 0.363s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e59951-2455-4005-b3d6-c11d952860a3]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:02 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:02 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 Sep 05 21:08:02 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:03 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" returned: 0 in 0.248s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423500b2-cfdd-4ac8-97a4-c199a5ee050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da173442-9dc3-4047-925a-52e44d85d0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:03 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Volume volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 (c81fddd8-749b-4b34-b21f-a96a7d2f8d15): created successfully Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da173442-9dc3-4047-925a-52e44d85d0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (d66ee054-4212-4d10-804a-2515cecae93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:03 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-6275e3fc-1ed1-4184-a88d-a5c51f04b0f6 tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:08:03 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" returned: 0 in 0.380s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:03 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 Sep 05 21:08:03 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot d29fa242-ffdd-4673-ad93-830e846457c2 of volume c81fddd8-749b-4b34-b21f-a96a7d2f8d15 {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9fddf1-f103-4fb3-8e49-388fe801c291]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:03 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 Sep 05 21:08:03 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:03 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2" returned: 0 in 0.374s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:03 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2 Sep 05 21:08:03 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:03 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" returned: 0 in 0.378s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:03 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 1G Sep 05 21:08:03 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:03 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6.dffd53f5-f7ed-4bfd-9151-b5f923be44e2" returned: 0 in 0.269s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-dffd53f5-f7ed-4bfd-9151-b5f923be44e2" released by "_delete_snapshot" :: held 1.476s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:03 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" released by "delete_snapshot" :: held 1.500s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Created reservations ['4abbb1aa-6ea3-43bc-962f-16373b9c04e2', '59e7af12-23f3-4249-a476-1ee9d8b161b5', '093cf8be-f4c7-4ff9-9f5a-c972bc738b57', '8b6aeb5e-9861-4952-80c4-e9cb6fef26b6'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:04 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Delete snapshot completed successfully. Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-88520e93-5c82-45eb-8a8e-854ab04a17d5 tempest-ProjectReaderTests-78117735 None] Lock "cinder-dffd53f5-f7ed-4bfd-9151-b5f923be44e2-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:04 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 1G" returned: 0 in 0.408s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:04 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 Sep 05 21:08:04 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:04 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2" returned: 0 in 0.302s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:04 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 is being set with open permissions: ugo+rw Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:04 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 Sep 05 21:08:04 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-14ee6de6-fa1f-43e9-98e8-f6956990d0d6-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Lock "cinder-14ee6de6-fa1f-43e9-98e8-f6956990d0d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Acquiring lock "cinder-quobyte-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf657a4-6c1f-420f-a299-66fa2181f9c2]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:04 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:04 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 Sep 05 21:08:04 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2" returned: 0 in 0.252s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:04 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:04 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.info Sep 05 21:08:04 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:05 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" returned: 0 in 0.355s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:05 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6 Sep 05 21:08:05 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:05 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.info" returned: 0 in 0.254s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:05 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.info is being set with open permissions: ugo+rw Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:05 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.info Sep 05 21:08:05 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:05 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" returned: 0 in 0.264s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Lock "cinder-quobyte-14ee6de6-fa1f-43e9-98e8-f6956990d0d6" released by "delete_volume" :: held 0.669s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:05 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.info" returned: 0 in 0.261s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-47909b82-18dd-45dc-856f-c7434d36fe98 tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Created reservations ['a7aacd65-539a-46cc-8938-c2be126af991', '5ad7604c-f6ab-4369-9523-dab5dda0d34d', 'e538d305-4847-406a-a08e-006f0e2c02f4', 'dc6962d3-1e5b-47db-ab1d-68104cb04c86'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:05 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:08:05 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-d29fa242-ffdd-4673-ad93-830e846457c2-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-d29fa242-ffdd-4673-ad93-830e846457c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-d29fa242-ffdd-4673-ad93-830e846457c2" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-d29fa242-ffdd-4673-ad93-830e846457c2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot d29fa242-ffdd-4673-ad93-830e846457c2 of volume c81fddd8-749b-4b34-b21f-a96a7d2f8d15 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[be120892-1d78-43d5-8cda-81e696aa294e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:05 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.268s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:05 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Deleted volume successfully. Sep 05 21:08:05 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-5322a8a6-a87d-4a45-b6d9-57772ea5dfcb tempest-ProjectReaderTests-78117735 None] Lock "cinder-14ee6de6-fa1f-43e9-98e8-f6956990d0d6-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:05 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 Sep 05 21:08:05 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:06 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2" returned: 0 in 0.387s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:06 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:08:06 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec82e602-d075-4f42-b363-67a7530f01ca]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:06 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 Sep 05 21:08:06 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:06 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" returned: 0 in 0.361s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:06 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 Sep 05 21:08:06 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:06 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2" returned: 0 in 0.343s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:06 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:06 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2 Sep 05 21:08:06 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:07 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15.d29fa242-ffdd-4673-ad93-830e846457c2" returned: 0 in 0.257s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-d29fa242-ffdd-4673-ad93-830e846457c2" released by "_delete_snapshot" :: held 1.447s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" released by "delete_snapshot" :: held 1.472s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Created reservations ['e8f4a2be-948b-43da-8fe2-9c87e879ca1b', 'e97c486d-4530-43c5-8c40-606f41c6d822', 'b82445bb-3c14-48ea-bc64-f0877a3bc1c4', '8400136b-9fbd-410b-b9c5-210383797a58'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:07 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-e19760f3-588f-4a82-bf22-38939f8b9d05 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-d29fa242-ffdd-4673-ad93-830e846457c2-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-c81fddd8-749b-4b34-b21f-a96a7d2f8d15-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-c81fddd8-749b-4b34-b21f-a96a7d2f8d15-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" acquired by "delete_volume" :: waited 0.014s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b62b230-b053-4983-b1cb-e94fb83557cd]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:07 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:07 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 Sep 05 21:08:07 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:08 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" returned: 0 in 0.360s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:08 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15 Sep 05 21:08:08 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:08 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" returned: 0 in 0.266s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-c81fddd8-749b-4b34-b21f-a96a7d2f8d15" released by "delete_volume" :: held 0.687s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Created reservations ['a5598321-caf1-4b25-a9a5-0adfb1f54e87', 'a045ecf2-af95-48a5-8833-dbb735738975', '638052e4-d088-47bc-b670-3e7ae2e16aba', '765f8329-af86-486e-80f6-9097e2845ebf'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:08 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:08:08 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:08 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.264s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:08 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:08:08 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-52d18c58-ba09-4313-99ec-c8c1e6d58204 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-c81fddd8-749b-4b34-b21f-a96a7d2f8d15-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (18a6e2af-235b-4296-b714-4b973d1ca1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210b761d-5737-4dc0-bb30-a5b12f3c18ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210b761d-5737-4dc0-bb30-a5b12f3c18ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-947024740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:09Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7412b6-a84e-4859-ae89-e6eafa700e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7412b6-a84e-4859-ae89-e6eafa700e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45aa1d5b-f5c6-4b21-990b-b853d098c712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45aa1d5b-f5c6-4b21-990b-b853d098c712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb', 'volume_name': 'volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df02622-370b-46b4-8945-580c9eb9a4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df02622-370b-46b4-8945-580c9eb9a4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8d0289-8f89-4438-89a6-4ad98e9b3b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:09 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Volume 3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb', 'volume_size': 1} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-947024740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f16ad1bcd14d14b43f9cdb3113b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:09Z,use_quota=True,user_id='51d2bb2e3afe43c88a96b68275a0383b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Creating volume 3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:08:09 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:09 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb 1073741824 Sep 05 21:08:09 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:09 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb 1073741824" returned: 0 in 0.425s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:09 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:09 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb Sep 05 21:08:09 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:10 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" returned: 0 in 0.243s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8d0289-8f89-4438-89a6-4ad98e9b3b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c485ac83-f13e-4647-a3e5-5fc5490fcd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:10 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Volume volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb (3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb): created successfully Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c485ac83-f13e-4647-a3e5-5fc5490fcd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Flow 'volume_create_manager' (18a6e2af-235b-4296-b714-4b973d1ca1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:10 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-09f7d1df-efd1-4733-8640-3639129131f2 tempest-ProjectMemberTests-1941667694 None] Created volume successfully. Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Creating offline snapshot ce605978-a296-4bbb-b17d-e782f51ba7eb of volume 3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2c61cf-aab4-4421-959b-86737b5df006]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:10 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:10 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb Sep 05 21:08:10 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:11 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" returned: 0 in 0.385s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:11 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb 1G Sep 05 21:08:11 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:11 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb 1G" returned: 0 in 0.425s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:11 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb Sep 05 21:08:11 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:11 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb" returned: 0 in 0.327s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:11 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb is being set with open permissions: ugo+rw Sep 05 21:08:11 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:11 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb Sep 05 21:08:11 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:12 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb" returned: 0 in 0.238s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:12 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.info Sep 05 21:08:12 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:12 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.info" returned: 0 in 0.256s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:12 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.info is being set with open permissions: ugo+rw Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:12 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.info Sep 05 21:08:12 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:12 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.info" returned: 0 in 0.242s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:12 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1dee9fcb-261e-4182-bd1c-0f567eab2308 tempest-ProjectMemberTests-1941667694 None] Create snapshot completed successfully Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-ce605978-a296-4bbb-b17d-e782f51ba7eb-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Lock "cinder-ce605978-a296-4bbb-b17d-e782f51ba7eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-ce605978-a296-4bbb-b17d-e782f51ba7eb" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-ce605978-a296-4bbb-b17d-e782f51ba7eb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:12 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Deleting offline snapshot ce605978-a296-4bbb-b17d-e782f51ba7eb of volume 3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] snapshot_file for this snap is: volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[846ffb7d-d3a2-4252-9302-1c870f5e10df]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:13 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb Sep 05 21:08:13 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:13 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb" returned: 0 in 0.392s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[95445957-f43d-43e6-bee4-dd177edb4d18]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:13 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb Sep 05 21:08:13 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:13 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" returned: 0 in 0.424s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:13 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:13 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb Sep 05 21:08:13 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:14 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb" returned: 0 in 0.435s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:14 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb Sep 05 21:08:14 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:14 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:14 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb.ce605978-a296-4bbb-b17d-e782f51ba7eb" returned: 0 in 0.294s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-ce605978-a296-4bbb-b17d-e782f51ba7eb" released by "_delete_snapshot" :: held 1.655s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" released by "delete_snapshot" :: held 1.679s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:14 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Created reservations ['5579156d-1868-4dd6-a17b-821dacba171e', '6d75fc42-2028-490a-bae9-ec2e73b607c7', 'af599087-7a51-49c4-817d-adf26f978e6b', '6485d3ec-1143-4957-aa11-6683bf7cd1e9'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:14 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Delete snapshot completed successfully. Sep 05 21:08:14 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-1d9e319c-77ed-47cd-82e3-d26b4c9f988d tempest-ProjectMemberTests-1941667694 None] Lock "cinder-ce605978-a296-4bbb-b17d-e782f51ba7eb-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "cinder-quobyte-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" acquired by "delete_volume" :: waited 0.016s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2262e0ec-e4f7-4b29-8e97-cf11f98d91f0]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:15 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb Sep 05 21:08:15 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:15 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" returned: 0 in 0.377s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:15 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb Sep 05 21:08:15 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:15 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" returned: 0 in 0.264s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-quobyte-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb" released by "delete_volume" :: held 0.705s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:15 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Created reservations ['446f928b-780a-4290-b1f3-eb31608f616d', 'fa8e2714-cb6e-4f90-a265-7f0bde21e463', 'b7cf9eaf-a1bc-463f-b2ce-7ae92657149b', '191cf1a5-356b-4217-a936-c232370934e0'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:16 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:08:16 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:16 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.317s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:16 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Deleted volume successfully. Sep 05 21:08:16 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-2b0cd8ab-a63a-4f18-84c9-c832dee0a963 tempest-ProjectMemberTests-1941667694 None] Lock "cinder-3bd8bbb4-bbf9-4e94-8a71-5ebfd8df3dcb-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:23 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=201,cinder:INSERT=67,cinder:UPDATE=257,cinder:DELETE=24 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:08:23 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:INSERT=74,cinder:UPDATE=258,cinder:SELECT=181,cinder:DELETE=18 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Flow 'volume_create_manager' (bb2dc841-8874-4809-835f-a55fe3e9b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa723ab9-4182-4179-922f-64d540746101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa723ab9-4182-4179-922f-64d540746101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1056163535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d37b1d-d183-4aa2-ab6b-95c4b90ef94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0bd54baaa8419a9c4412fc4d607115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:26Z,use_quota=True,user_id='4f1de0a8c8004178b7f6841f8e0d30ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584e00ae-7bd0-4237-91d2-5c7502786c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584e00ae-7bd0-4237-91d2-5c7502786c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7d173b-9c29-45d0-9f61-33a29db18a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7d173b-9c29-45d0-9f61-33a29db18a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d37b1d-d183-4aa2-ab6b-95c4b90ef94f', 'volume_name': 'volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374ba8e7-3e70-4ca9-a568-f680f74e88d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374ba8e7-3e70-4ca9-a568-f680f74e88d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b462db09-9714-4068-8260-bd9e3468ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:26 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Volume 78d37b1d-d183-4aa2-ab6b-95c4b90ef94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f', 'volume_size': 1} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1056163535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d37b1d-d183-4aa2-ab6b-95c4b90ef94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0bd54baaa8419a9c4412fc4d607115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:26Z,use_quota=True,user_id='4f1de0a8c8004178b7f6841f8e0d30ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)}" {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Creating volume 78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:08:26 devstack cinder-volume[87802]: INFO cinder.volume.drivers.remotefs [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] casted to osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f 1073741824 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:26 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f 1073741824 Sep 05 21:08:26 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:26 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f 1073741824" returned: 0 in 0.422s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:26 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:26 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f Sep 05 21:08:26 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:27 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" returned: 0 in 0.269s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'} {{(pid=87802) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b462db09-9714-4068-8260-bd9e3468ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f', 'volume_size': 1}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34862739-7186-4bd4-af54-47ba8c8be75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:27 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Volume volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f (78d37b1d-d183-4aa2-ab6b-95c4b90ef94f): created successfully Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34862739-7186-4bd4-af54-47ba8c8be75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Flow 'volume_create_manager' (bb2dc841-8874-4809-835f-a55fe3e9b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:27 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-a7fd3692-948e-4ac6-a35b-ebdd61babfbb tempest-SnapshotDependencyTests-389028065 None] Created volume successfully. Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Creating offline snapshot ea7ece50-affe-4575-8483-2a2babb9fa06 of volume 78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d39dcff-bea9-47a4-9c08-151c2ba020c7]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:27 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:27 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f Sep 05 21:08:27 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:28 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" returned: 0 in 0.364s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 1G {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:28 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 1G Sep 05 21:08:28 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:28 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 1G" returned: 0 in 0.445s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:28 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 Sep 05 21:08:28 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:28 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f -F qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06" returned: 0 in 0.298s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:28 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 is being set with open permissions: ugo+rw Sep 05 21:08:28 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:28 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 Sep 05 21:08:28 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:29 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06" returned: 0 in 0.243s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:29 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.info Sep 05 21:08:29 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:29 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.info" returned: 0 in 0.271s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:29 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.info is being set with open permissions: ugo+rw Sep 05 21:08:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.info {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:29 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.info Sep 05 21:08:29 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:29 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.info" returned: 0 in 0.255s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:29 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:29 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-8417eb64-6d3d-4ad4-8964-4386bf0797ff tempest-SnapshotDependencyTests-389028065 None] Create snapshot completed successfully Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.flows.manager.create_volume [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87802) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Flow 'volume_create_manager' (95badb27-9459-42b5-933e-f79858f19646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f76f902-3159-4900-a6b3-68250857ede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f76f902-3159-4900-a6b3-68250857ede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576ea10c-b88a-4a4d-ade8-7b216837dd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0bd54baaa8419a9c4412fc4d607115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea7ece50-affe-4575-8483-2a2babb9fa06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:30Z,use_quota=True,user_id='4f1de0a8c8004178b7f6841f8e0d30ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfd0a89-b804-4340-983c-a3751955fbf2),volume_type_id=bbfd0a89-b804-4340-983c-a3751955fbf2)' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d936f6-91fe-4797-a300-990e9305a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d936f6-91fe-4797-a300-990e9305a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4a768d-5f55-4cb6-8bb2-cc8ec485691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4a768d-5f55-4cb6-8bb2-cc8ec485691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '576ea10c-b88a-4a4d-ade8-7b216837dd3a', 'volume_name': 'volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a', 'volume_size': 1, 'snapshot_id': 'ea7ece50-affe-4575-8483-2a2babb9fa06'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcae3ad8-a144-4e8a-b3eb-2c579300c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcae3ad8-a144-4e8a-b3eb-2c579300c934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3124e21b-513c-469e-bdb0-86f397cac30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:30 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Volume 576ea10c-b88a-4a4d-ade8-7b216837dd3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a', 'volume_size': 1, 'snapshot_id': 'ea7ece50-affe-4575-8483-2a2babb9fa06'} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-quobyte-ea7ece50-affe-4575-8483-2a2babb9fa06-576ea10c-b88a-4a4d-ade8-7b216837dd3a" by "_create_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-ea7ece50-affe-4575-8483-2a2babb9fa06-576ea10c-b88a-4a4d-ade8-7b216837dd3a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Creating volume 576ea10c-b88a-4a4d-ade8-7b216837dd3a from snapshot ea7ece50-affe-4575-8483-2a2babb9fa06 {{(pid=87802) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Selected osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c as target Quobyte volume. {{(pid=87802) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-quobyte-576ea10c-b88a-4a4d-ade8-7b216837dd3a" by "_copy_volume_from_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-576ea10c-b88a-4a4d-ade8-7b216837dd3a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] snapshot: ea7ece50-affe-4575-8483-2a2babb9fa06, volume: 576ea10c-b88a-4a4d-ade8-7b216837dd3a, {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa231ff-f679-4b3a-b789-11970e1becd8]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:30 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 Sep 05 21:08:30 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:30 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06" returned: 0 in 0.353s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[2278c008-011f-4b4a-8d85-669ec7f9e147]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:30 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:31 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f Sep 05 21:08:31 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:31 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" returned: 0 in 0.347s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 21:08:31 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Creating direct copy from snapshot {{(pid=87802) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 21:08:31 devstack cinder-volume[87802]: DEBUG cinder.utils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Path /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a not found in is_blk_device check {{(pid=87802) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:08:31 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:31 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a Sep 05 21:08:31 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:36 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a" returned: 0 in 4.734s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG cinder.image.image_utils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Image conversion details: src /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a {{(pid=87802) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:08:36 devstack cinder-volume[87802]: INFO cinder.image.image_utils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Converted 1024.00 MB image at 216.21 MB/s Sep 05 21:08:36 devstack cinder-volume[87802]: WARNING cinder.volume.drivers.remotefs [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a is being set with open permissions: ugo+rw Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:36 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a Sep 05 21:08:36 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:36 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a" returned: 0 in 0.275s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-576ea10c-b88a-4a4d-ade8-7b216837dd3a" released by "_copy_volume_from_snapshot" :: held 5.792s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-ea7ece50-affe-4575-8483-2a2babb9fa06-576ea10c-b88a-4a4d-ade8-7b216837dd3a" released by "_create_volume_from_snapshot" :: held 5.865s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.883s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3124e21b-513c-469e-bdb0-86f397cac30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a', 'volume_size': 1, 'snapshot_id': 'ea7ece50-affe-4575-8483-2a2babb9fa06'}' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfba7da5-ab91-4c24-b0d0-f4b1a244c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:36 devstack cinder-volume[87802]: INFO cinder.volume.flows.manager.create_volume [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Volume volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a (576ea10c-b88a-4a4d-ade8-7b216837dd3a): created successfully Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfba7da5-ab91-4c24-b0d0-f4b1a244c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87802) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:36 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Flow 'volume_create_manager' (95badb27-9459-42b5-933e-f79858f19646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87802) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:36 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-7828c967-f58e-41c4-a0ae-0910c5f96eb6 tempest-SnapshotDependencyTests-389028065 None] Created volume successfully. Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-ea7ece50-affe-4575-8483-2a2babb9fa06-delete_snapshot" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-ea7ece50-affe-4575-8483-2a2babb9fa06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-quobyte-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" by "delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-quobyte-ea7ece50-affe-4575-8483-2a2babb9fa06" by "_delete_snapshot" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-ea7ece50-affe-4575-8483-2a2babb9fa06" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Deleting offline snapshot ea7ece50-affe-4575-8483-2a2babb9fa06 of volume 78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] snapshot_file for this snap is: volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 {{(pid=87802) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5c1048-1741-4451-93ee-325fca4eed3a]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:37 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 Sep 05 21:08:37 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:37 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.remotefs [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87802) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[e147f795-41f2-494d-be5b-e7f85a5f499f]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:37 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:37 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f Sep 05 21:08:37 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:38 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" returned: 0 in 0.535s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:38 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 Sep 05 21:08:38 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:38 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06" returned: 0 in 0.342s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:38 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06 Sep 05 21:08:38 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:38 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f.ea7ece50-affe-4575-8483-2a2babb9fa06" returned: 0 in 0.253s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-ea7ece50-affe-4575-8483-2a2babb9fa06" released by "_delete_snapshot" :: held 1.621s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" released by "delete_snapshot" :: held 1.647s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Created reservations ['6211db2c-2ad5-4094-b185-3181f0def11b', 'fdb09c29-4603-436d-a55c-bbdc160f8b60', 'a5901bc1-7579-42a9-aff2-edf9db6b1c2c', '5ea1ce5f-66d0-45d5-a587-660e3376b49b'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:38 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Delete snapshot completed successfully. Sep 05 21:08:38 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-616343e4-06f0-43eb-b3d9-6dbb0418f0d6 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-ea7ece50-affe-4575-8483-2a2babb9fa06-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-quobyte-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:39 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:39 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a20e30-daed-4167-a8a6-a0e8f380a0c1]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:39 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f Sep 05 21:08:39 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:39 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" returned: 0 in 0.381s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:39 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:39 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f Sep 05 21:08:39 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:40 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" returned: 0 in 0.269s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f" released by "delete_volume" :: held 0.721s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Created reservations ['8c974bf4-bfaf-4811-85e9-4f610a438866', '028f36e4-443d-4287-ac61-d836a24eeb9a', '38232bdd-4176-4749-91a2-854a8d0733d2', '5574fd38-cdb1-4b42-85a7-89bb27aeb066'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:40 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:08:40 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:40 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-576ea10c-b88a-4a4d-ade8-7b216837dd3a-delete_volume" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.249s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:40 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Deleted volume successfully. Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-576ea10c-b88a-4a4d-ade8-7b216837dd3a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-bf3ffaf4-9d04-4fe4-935d-919f42a14040 tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-78d37b1d-d183-4aa2-ab6b-95c4b90ef94f-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "cinder-quobyte-576ea10c-b88a-4a4d-ade8-7b216837dd3a" by "delete_volume" {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-576ea10c-b88a-4a4d-ade8-7b216837dd3a" acquired by "delete_volume" :: waited 0.018s {{(pid=87802) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c59fbc-ec08-431f-a398-002aebb6a97e]: (4, 'qcow2') {{(pid=88769) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:40 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a Sep 05 21:08:40 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:40 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a" returned: 0 in 0.371s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:40 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:40 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a Sep 05 21:08:40 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:41 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2/volume-576ea10c-b88a-4a4d-ade8-7b216837dd3a" returned: 0 in 0.282s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-quobyte-576ea10c-b88a-4a4d-ade8-7b216837dd3a" released by "delete_volume" :: held 0.702s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG cinder.quota [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Created reservations ['717e8998-c1e3-4fe9-b912-1093d721186b', 'ce4d3801-74d0-44bf-b8bf-cdfc88c11ee1', 'a6c82f48-793c-42ca-a7d7-f76a3b0cfab6', '378d1b81-c41c-4405-abae-b463dc0201b6'] {{(pid=87802) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:41 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:08:41 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:41 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.290s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:41 devstack cinder-volume[87802]: INFO cinder.volume.manager [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Deleted volume successfully. Sep 05 21:08:41 devstack cinder-volume[87802]: DEBUG cinder.coordination [None req-528552d0-7bfd-426e-b2fb-11d76f01c0cd tempest-SnapshotDependencyTests-389028065 None] Lock "cinder-576ea10c-b88a-4a4d-ade8-7b216837dd3a-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87802) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:51 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:UPDATE=30,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:08:51 devstack cinder-volume[87802]: DEBUG dbcounter [-] [87802] Writing DB stats cinder:SELECT=28,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c': None} {{(pid=87802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG cinder.volume.drivers.quobyte [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-794ee8e6-bbd4-4423-8f73-48aa6912955c'] {{(pid=87802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.lockutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:55 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2 Sep 05 21:08:55 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:55 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG oslo_concurrency.processutils [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5af5bb7cad4265642fb2cf20f06886f2" returned: 0 in 0.242s {{(pid=87802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG cinder.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Notifying Schedulers of capabilities ... {{(pid=87802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG oslo_service.periodic_task [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] Running periodic task VolumeManager._thread_info {{(pid=87802) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread count: 28 {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:08:55 devstack cinder-volume[87802]: DEBUG cinder.volume.manager [None req-c599bea6-7ac7-40bf-8c7f-c1714f804efe None None] thread info: [<_MainThread(MainThread, started 129606750679168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87802) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}